May 21 18:02:45.789938 ip-10-0-133-143 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 18:02:45.789950 ip-10-0-133-143 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 18:02:45.789957 ip-10-0-133-143 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 18:02:45.790262 ip-10-0-133-143 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 18:02:55.849461 ip-10-0-133-143 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 18:02:55.849479 ip-10-0-133-143 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ef7a48fc3f43473f9dcacd5e2f1feff2 --
May 21 18:05:17.613996 ip-10-0-133-143 systemd[1]: Starting Kubernetes Kubelet...
May 21 18:05:18.126672 ip-10-0-133-143 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:05:18.126672 ip-10-0-133-143 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 18:05:18.126672 ip-10-0-133-143 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:05:18.127777 ip-10-0-133-143 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 18:05:18.127777 ip-10-0-133-143 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:05:18.129298 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.129203    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 18:05:18.132029 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132014    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:05:18.132029 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132030    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132034    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132038    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132040    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132043    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132046    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132049    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132052    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132055    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132058    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132060    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132063    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132066    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132069    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132071    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132074    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132076    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132079    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132082    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132085    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:05:18.132092 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132087    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132090    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132092    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132095    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132098    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132101    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132104    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132106    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132110    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132112    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132114    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132117    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132119    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132122    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132125    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132127    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132130    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132132    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132135    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132139    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:05:18.132570 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132141    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132144    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132146    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132148    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132151    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132153    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132156    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132159    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132161    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132165    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132169    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132172    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132175    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132177    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132180    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132184    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132186    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132189    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132192    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:05:18.133111 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132195    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132197    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132200    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132202    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132205    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132207    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132210    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132213    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132216    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132219    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132221    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132224    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132227    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132229    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132232    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132234    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132237    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132239    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132241    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132244    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:05:18.133580 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132247    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132251    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132253    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132256    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132259    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132263    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132648    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132671    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132676    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132679    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132681    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132685    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132688    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132691    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132693    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132696    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132698    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132701    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132712    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132714    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:05:18.134067 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132717    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132720    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132723    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132725    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132728    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132730    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132733    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132735    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132738    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132741    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132743    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132746    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132749    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132751    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132754    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132757    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132759    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132762    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132764    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132767    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:05:18.134547 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132770    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132773    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132775    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132778    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132781    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132785    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132789    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132793    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132796    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132798    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132801    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132804    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132807    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132809    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132812    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132814    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132817    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132820    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132822    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:05:18.135059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132825    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132827    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132830    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132832    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132835    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132837    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132840    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132842    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132845    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132848    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132851    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132854    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132856    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132859    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132861    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132864    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132866    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132869    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132872    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132874    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:05:18.135561 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132877    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132879    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132882    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132884    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132887    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132892    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132894    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132897    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132900    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132903    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132906    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132909    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.132913    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133638    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133646    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133665    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133670    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133674    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133678    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133682    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133687    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 18:05:18.136069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133690    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133694    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133697    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133701    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133704    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133708    2557 flags.go:64] FLAG: --cgroup-root=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133711    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133714    2557 flags.go:64] FLAG: --client-ca-file=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133716    2557 flags.go:64] FLAG: --cloud-config=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133719    2557 flags.go:64] FLAG: --cloud-provider="external"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133722    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133730    2557 flags.go:64] FLAG: --cluster-domain=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133733    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133736    2557 flags.go:64] FLAG: --config-dir=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133739    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133743    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133747    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133750    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133753    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133757    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133760    2557 flags.go:64] FLAG: --contention-profiling="false"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133763    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133766    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133770    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133773    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 18:05:18.136582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133777    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133780    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133783    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133786    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133789    2557 flags.go:64] FLAG: --enable-server="true"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133792    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133796    2557 flags.go:64] FLAG: --event-burst="100"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133799    2557 flags.go:64] FLAG: --event-qps="50"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133803    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133806    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133809    2557 flags.go:64] FLAG: --eviction-hard=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133813    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133816    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133819    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133821    2557 flags.go:64] FLAG: --eviction-soft=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133824    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133827    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133830    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133833    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133836    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133839    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133842    2557 flags.go:64] FLAG: --feature-gates=""
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133846    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133849    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133852    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 18:05:18.137208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133856    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133860    2557 flags.go:64] FLAG: --healthz-port="10248"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133863    2557 flags.go:64] FLAG: --help="false"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133866    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-133-143.ec2.internal"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133869    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133872    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133875    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133878    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133882    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133885    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133887    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133891    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133893    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133896    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133899    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133902    2557 flags.go:64] FLAG: --kube-reserved=""
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133906    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133909    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133912    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133915    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133918    2557 flags.go:64] FLAG: --lock-file=""
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133920    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133923    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133926    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 18:05:18.137811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133932    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133935    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133938    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133941    2557 flags.go:64] FLAG: --logging-format="text"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133944    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133948    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133950    2557 flags.go:64] FLAG: --manifest-url=""
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133953    2557 flags.go:64] FLAG: --manifest-url-header=""
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133958    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133962    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133966    2557 flags.go:64] FLAG: --max-pods="110"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133969    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133972    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133975    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133979    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133982    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133985    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133988    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133995    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.133999    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134001    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134005    2557 flags.go:64] FLAG: --pod-cidr=""
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134008    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 18:05:18.138405 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134013    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134017    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134020    2557 flags.go:64] FLAG: --pods-per-core="0"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134023    2557 flags.go:64] FLAG: --port="10250"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134026    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134029    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06dee672be7752516"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134033    2557 flags.go:64] FLAG: --qos-reserved=""
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134036    2557 flags.go:64] FLAG: --read-only-port="10255"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134039    2557 flags.go:64] FLAG: --register-node="true"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134042    2557 flags.go:64] FLAG: --register-schedulable="true"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134045    2557 flags.go:64] FLAG: --register-with-taints=""
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134048    2557 flags.go:64] FLAG: --registry-burst="10"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134051    2557 flags.go:64] FLAG: --registry-qps="5"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134054    2557 flags.go:64] FLAG: --reserved-cpus=""
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134057    2557 flags.go:64] FLAG: --reserved-memory=""
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134061    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134064    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134067    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134073    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134077    2557 flags.go:64] FLAG: --runonce="false"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134080    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134083    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134086    2557 flags.go:64] FLAG: --seccomp-default="false"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134089    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134092    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134095    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 18:05:18.138983 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134098    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134102    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134105    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134107    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134110    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134113    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134116    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134120    2557 flags.go:64] FLAG: --system-cgroups=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134123    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134129    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134132    2557 flags.go:64] FLAG: --tls-cert-file=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134135    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134139    2557 flags.go:64] FLAG: --tls-min-version=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134142    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134145    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134148    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134151    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134154    2557 flags.go:64] FLAG: --v="2"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134158    2557 flags.go:64] FLAG: --version="false"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134162    2557 flags.go:64] FLAG: --vmodule=""
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134166    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134170    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134261    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134265    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:05:18.139604 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134270    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134273    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134277    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134279    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134282    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134285    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134287    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134290    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134293    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134295    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134298    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134301    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134305    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134308    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134311    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134318    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134321    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134324    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134327    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134329    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:05:18.140178 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134332    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134334    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134337    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134340    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134342    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134346    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134349    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134352    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134355    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134357    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134360    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134363    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134367    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134370    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134372    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134375    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134378    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134381    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134383    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134386    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:05:18.141150 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134389    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134392    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134394    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134397    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134399    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134402    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134404    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134409    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134411    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134414    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134416    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134419    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134422    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134424    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134426    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134429    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134431    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134434    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134437    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134439    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:05:18.142125 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134441    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134444    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134446    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134449    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134453    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134455    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134458    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134460    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134463    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134466    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134469    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134471    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134474    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134476    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134478    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134481    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134483    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134486    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134488    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134492    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:05:18.142931 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134494    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:05:18.143509 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134497    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:05:18.143509 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134500    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:05:18.143509 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.134503    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:05:18.143509 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.134965    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:05:18.144801 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.144683    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 18:05:18.144801 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.144802    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144861    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144866    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144870    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144874    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144877    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144880    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144883    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144886    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144889    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144892    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144895    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144897    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144900    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144903    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:05:18.144898 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144906    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144909    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144911    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144914    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144917    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144920    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144923    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144926    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144928    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144931    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144936    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144940    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144943    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144946    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144949    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144952    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144955    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144958    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144960    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:05:18.145271 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144963    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144966    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144969    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144972    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144975    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144978    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144980    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144982    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144985    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144987    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144990    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144993    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144995    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.144998    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145000    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145004    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145008    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145012    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145015    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145018    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:05:18.145848 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145021    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145023    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145026    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145028    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145031    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145033    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145036    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145038    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145041    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145043    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145046    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145048    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145051    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145054    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145056    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145059    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145062    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145064    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145067    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:05:18.146333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145069    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145072    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145074    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145078    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145082    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145085    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145088    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145090    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145093    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145095    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145098    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145101    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145103    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145106    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.145111    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145207    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:05:18.146810 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145213    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145216    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145219    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145222    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145225    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145228    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145230    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145234    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145237    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145239    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145242    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145245    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145247    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145250    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145253    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145255    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145258    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145260    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145263    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145266    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:05:18.147209 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145268    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145272    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145274    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145277    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145280    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145283    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145286    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145288    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145291    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145294    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145296    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145299    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145301    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145304    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145306    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145309    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145312    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145314    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145318    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:05:18.147714 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145322    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145325    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145327    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145330    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145333    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145336    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145338    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145341    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145343    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145346    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145348    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145351    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145354    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145357    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145359    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145363    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145365    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145368    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145370    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:05:18.148173 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145373    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145376    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145378    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145381    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145384    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145386    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145389    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145391    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145394    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145396    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145399    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145401    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145404    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145406    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145410    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145413    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145416    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145418    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145421    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:05:18.148627 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145424    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145426    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145429    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145431    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145433    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145436    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145439    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:18.145441    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.145446    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:05:18.149099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.146198    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 18:05:18.152420 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.152406    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 18:05:18.153383 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.153369    2557 server.go:1019] "Starting client certificate rotation"
May 21 18:05:18.153491 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.153472    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:05:18.153531 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.153511    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:05:18.182662 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.182635    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:05:18.189217 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.189199    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:05:18.204109 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.204093    2557 log.go:25] "Validated CRI v1 runtime API"
May 21 18:05:18.210031 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.210013    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:05:18.210885 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.210870    2557 log.go:25] "Validated CRI v1 image API"
May 21 18:05:18.212523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.212508    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 18:05:18.218476 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.218458    2557 fs.go:135] Filesystem UUIDs: map[4089a51b-538e-4db1-84a8-962ca50d9436:/dev/nvme0n1p4 60d4eefd-55e5-4816-9aec-35b7d126c969:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 21 18:05:18.218537 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.218476    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 18:05:18.222663 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.222551    2557 manager.go:217] Machine: {Timestamp:2026-05-21 18:05:18.222058308 +0000 UTC m=+0.473570740 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111546 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2537ee74801bc878c10d7904a2ada5 SystemUUID:ec2537ee-7480-1bc8-78c1-0d7904a2ada5 BootID:ef7a48fc-3f43-473f-9dca-cd5e2f1feff2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:31:9a:72:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:31:9a:72:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:99:18:d1:ad:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 18:05:18.223506 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.223495    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 18:05:18.223641 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.223628    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 18:05:18.227142 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.227117    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 18:05:18.227275 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.227145    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 18:05:18.227324 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.227284    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 21 18:05:18.227324 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.227294    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 21 18:05:18.227324 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.227302    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:05:18.228195 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.228185    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:05:18.229481 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.229471    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:05:18.229590 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.229581    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 18:05:18.232113 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.232104    2557 kubelet.go:491] "Attempting to sync node with API server"
May 21 18:05:18.232148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.232117    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 18:05:18.232148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.232128    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 18:05:18.232148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.232138    2557 kubelet.go:397] "Adding apiserver pod source"
May 21 18:05:18.232148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.232146    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 18:05:18.233744 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.233729    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:05:18.233823 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.233755    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:05:18.237378 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.237356    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 18:05:18.239120 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239107    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 18:05:18.239811 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239800    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239816    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239822    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239827    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239835    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239841    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239846    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 18:05:18.239850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239852    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 18:05:18.240099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239859    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 18:05:18.240099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239865    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 18:05:18.240099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.239873    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 18:05:18.240198 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.240105    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 18:05:18.241236 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.241223    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 18:05:18.241236 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.241234    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 18:05:18.242903 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.242844    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 18:05:18.243130 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.243095    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 18:05:18.244569 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.244555    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 18:05:18.244641 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.244593    2557 server.go:1295] "Started kubelet"
May 21 18:05:18.244716 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.244663    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 18:05:18.244766 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.244691    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 18:05:18.244766 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.244757    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 18:05:18.245148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.245126    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 18:05:18.245332 ip-10-0-133-143 systemd[1]: Started Kubernetes Kubelet.
May 21 18:05:18.246057 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.245959    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 18:05:18.247616 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.247599    2557 server.go:317] "Adding debug handlers to kubelet server"
May 21 18:05:18.253835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.253791    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 18:05:18.253914 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.252846    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-143.ec2.internal.18b1a6caeb03fc29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-143.ec2.internal,UID:ip-10-0-133-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-143.ec2.internal,},FirstTimestamp:2026-05-21 18:05:18.244568105 +0000 UTC m=+0.496080538,LastTimestamp:2026-05-21 18:05:18.244568105 +0000 UTC m=+0.496080538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-143.ec2.internal,}"
May 21 18:05:18.254213 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.254196    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 18:05:18.254342 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.254331    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 18:05:18.254403 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.254345    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 18:05:18.254908 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.254781    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 18:05:18.255008 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.254996    2557 factory.go:55] Registering systemd factory
May 21 18:05:18.255058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.255013    2557 factory.go:223] Registration of the systemd container factory successfully
May 21 18:05:18.255058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.255029    2557 reconstruct.go:97] "Volume reconstruction finished"
May 21 18:05:18.255058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.255038    2557 reconciler.go:26] "Reconciler: start to sync state"
May 21 18:05:18.256330 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.256308    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.256415 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.256384    2557 factory.go:153] Registering CRI-O factory
May 21 18:05:18.256415 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.256402    2557 factory.go:223] Registration of the crio container factory successfully
May 21 18:05:18.256520 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.256461    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 18:05:18.256520 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.256489    2557 factory.go:103] Registering Raw factory
May 21 18:05:18.256520 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.256514    2557 manager.go:1196] Started watching for new ooms in manager
May 21 18:05:18.258456 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.258304    2557 manager.go:319] Starting recovery of all containers
May 21 18:05:18.261037 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.260993    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 18:05:18.261113 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.261097    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 18:05:18.261167 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.261148    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 18:05:18.264315 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.264295    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fj6ns"
May 21 18:05:18.269816 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.269802    2557 manager.go:324] Recovery completed
May 21 18:05:18.272962 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.272945    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fj6ns"
May 21 18:05:18.273439 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.273428    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.275096 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275080    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.275149 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275108    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.275149 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275119    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.275570 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275555    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 18:05:18.275570 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275571    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 18:05:18.275684 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.275587    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:05:18.278156 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.278098    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-143.ec2.internal.18b1a6caecd5cd53  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-143.ec2.internal,UID:ip-10-0-133-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-143.ec2.internal,},FirstTimestamp:2026-05-21 18:05:18.275095891 +0000 UTC m=+0.526608323,LastTimestamp:2026-05-21 18:05:18.275095891 +0000 UTC m=+0.526608323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-143.ec2.internal,}"
May 21 18:05:18.278807 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.278794    2557 policy_none.go:49] "None policy: Start"
May 21 18:05:18.278854 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.278810    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 18:05:18.278854 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.278821    2557 state_mem.go:35] "Initializing new in-memory state store"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316215    2557 manager.go:341] "Starting Device Plugin manager"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.316261    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316270    2557 server.go:85] "Starting device plugin registration server"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316468    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316481    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316562    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316635    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.316643    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.317326    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 18:05:18.337646 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.317362    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.384686 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.384617    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 18:05:18.385790 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.385768    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 18:05:18.385790 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.385793    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 18:05:18.385919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.385818    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 18:05:18.385919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.385833    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 18:05:18.385919 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.385877    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 18:05:18.390536 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.390518    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:05:18.417351 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.417334    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.418337 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.418321    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.418410 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.418355    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.418410 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.418371    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.418410 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.418401    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-143.ec2.internal"
May 21 18:05:18.427156 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.427139    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-143.ec2.internal"
May 21 18:05:18.427221 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.427159    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-143.ec2.internal\": node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.441618 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.441596    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.486902 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.486881    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"]
May 21 18:05:18.486991 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.486953    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.487755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.487741    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.487820 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.487769    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.487820 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.487781    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.489981 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.489969    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.490127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490113    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.490165 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490143    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.490684 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490666    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.490684 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490680    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.490783 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490698    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.490783 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490701    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.490783 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490710    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.490783 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.490716    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.492840 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.492826    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.492881 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.492856    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:05:18.493523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.493504    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:05:18.493602 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.493536    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:05:18.493602 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.493551    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID"
May 21 18:05:18.525307 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.525288    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-143.ec2.internal\" not found" node="ip-10-0-133-143.ec2.internal"
May 21 18:05:18.530913 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.530887    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-143.ec2.internal\" not found" node="ip-10-0-133-143.ec2.internal"
May 21 18:05:18.542076 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.542057    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.555976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.555953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.643029 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.642978    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.656274 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.656251    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.656329 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.656300    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.656329 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.656322    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.656403 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.656341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12ba3cafa5e44bfecf51edb64109fc5d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"12ba3cafa5e44bfecf51edb64109fc5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.743690 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.743642    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.756982 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.756963    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12ba3cafa5e44bfecf51edb64109fc5d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"12ba3cafa5e44bfecf51edb64109fc5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.757044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.756986    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.757044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.757015    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa416b0fcab06364ab4a6f9b3d393aed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"aa416b0fcab06364ab4a6f9b3d393aed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.757114 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.757064    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12ba3cafa5e44bfecf51edb64109fc5d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"12ba3cafa5e44bfecf51edb64109fc5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.828154 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.828119    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.834905 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:18.834874    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:18.844098 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.844076    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:18.944601 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:18.944538    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.045120 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.045098    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.145580 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.145557    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.153726 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.153704    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 18:05:19.153853 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.153838    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:05:19.245757 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.245702    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.254645 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.254625    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 18:05:19.265094 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.265074    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:05:19.274989 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.274954    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:00:18 +0000 UTC" deadline="2027-12-17 11:16:21.982909721 +0000 UTC"
May 21 18:05:19.275085 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.274990    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13793h11m2.707924141s"
May 21 18:05:19.286894 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.286874    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gh7fx"
May 21 18:05:19.295107 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.295086    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gh7fx"
May 21 18:05:19.346663 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.346628    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.392508 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:19.392482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ba3cafa5e44bfecf51edb64109fc5d.slice/crio-c80043e4baa1a8443128254f071b4261787356b25ba423e37359de8d86d2c99a WatchSource:0}: Error finding container c80043e4baa1a8443128254f071b4261787356b25ba423e37359de8d86d2c99a: Status 404 returned error can't find the container with id c80043e4baa1a8443128254f071b4261787356b25ba423e37359de8d86d2c99a
May 21 18:05:19.392722 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:19.392705    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa416b0fcab06364ab4a6f9b3d393aed.slice/crio-7cf47e1864777d0b9f7b9797b1fff30199359772a2ef8cd965b9ca2f7179fd52 WatchSource:0}: Error finding container 7cf47e1864777d0b9f7b9797b1fff30199359772a2ef8cd965b9ca2f7179fd52: Status 404 returned error can't find the container with id 7cf47e1864777d0b9f7b9797b1fff30199359772a2ef8cd965b9ca2f7179fd52
May 21 18:05:19.396357 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.396343    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:05:19.447669 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.447499    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.508249 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.508200    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:05:19.548275 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:19.548255    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found"
May 21 18:05:19.559919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.559901    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:05:19.654917 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.654900    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"
May 21 18:05:19.670398 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.670378    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:05:19.672269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.672253    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"
May 21 18:05:19.686067 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.686050    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:05:19.828145 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.828053    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:05:19.981862 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:19.981705    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:05:20.233516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.233488    2557 apiserver.go:52] "Watching apiserver"
May 21 18:05:20.241849 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.241815    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 18:05:20.242225 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.242196    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal","openshift-multus/multus-additional-cni-plugins-b5d2r","openshift-multus/multus-zx4s6","kube-system/konnectivity-agent-2282w","kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal","openshift-multus/network-metrics-daemon-9pxr6","openshift-network-diagnostics/network-check-target-gk46d","openshift-network-operator/iptables-alerter-bqqvk","openshift-ovn-kubernetes/ovnkube-node-5vpsl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p","openshift-cluster-node-tuning-operator/tuned-kbw8z","openshift-image-registry/node-ca-jcg4d"]
May 21 18:05:20.245051 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.245028    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.247380 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247357    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.247474 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247460    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 18:05:20.247851 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247649    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 18:05:20.247851 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247709    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 18:05:20.247851 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247819    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 18:05:20.248054 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.247939    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 18:05:20.248054 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.248005    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l2db5\""
May 21 18:05:20.249750 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.249587    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.249750 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.249647    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 18:05:20.250021 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.250003    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-whvmn\""
May 21 18:05:20.253051 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.252983    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 18:05:20.253851 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.252984    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 18:05:20.253973 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.253691    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vzsbr\""
May 21 18:05:20.256027 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.255999    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.256110 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.256077    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:20.258175 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.258102    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:20.258175 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.258151    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:20.258315 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.258246    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.260459 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.260421    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 18:05:20.260806 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.260786    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qq2bz\""
May 21 18:05:20.261049 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.261032    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 18:05:20.261238 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.261221    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 18:05:20.263109 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.263040    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.263347 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.263292    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.265280 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265374 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265295    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265374 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265324    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-cni-binary-copy\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265374 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-k8s-cni-cncf-io\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-bin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265398    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-multus\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-cnibin\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-netns\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxpcp\" (UniqueName: \"kubernetes.io/projected/73007daa-d2c1-4772-84ff-16f19af37d04-kube-api-access-vxpcp\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-socket-dir-parent\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-etc-kubernetes\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-os-release\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265634    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-system-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-multus-certs\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2162043b-4854-47bd-8cbb-15e63d7bec35-agent-certs\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-kubelet\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-system-cni-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.265831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2xz\" (UniqueName: \"kubernetes.io/projected/923dadc4-29a6-4dab-8426-f17d19e8698b-kube-api-access-6z2xz\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-hostroot\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265883    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-multus-daemon-config\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-kube-api-access-lfj94\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.265977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-cnibin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-conf-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2162043b-4854-47bd-8cbb-15e63d7bec35-konnectivity-ca\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.266335 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-os-release\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266349    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266550    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266760    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266766    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266808    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rfpmw\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266847    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 18:05:20.266852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.266771    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 18:05:20.267170 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267133    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 18:05:20.267330 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267306    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 18:05:20.267909 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267476    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lk2fv\""
May 21 18:05:20.267909 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267529    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 18:05:20.267909 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267593    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.267909 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.267704    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270619    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270756    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kg9c9\""
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270779    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270759    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270831    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 18:05:20.271044 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.270976    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 18:05:20.271370 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.271084    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mscwt\""
May 21 18:05:20.296093 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.296071    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:00:19 +0000 UTC" deadline="2027-11-02 11:39:45.548949265 +0000 UTC"
May 21 18:05:20.296093 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.296093    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12713h34m25.252859215s"
May 21 18:05:20.355851 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.355823    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 18:05:20.366338 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366313    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.366338 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366341    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-cni-binary-copy\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366358    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-k8s-cni-cncf-io\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366378    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-multus\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-var-lib-kubelet\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366464    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-netd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366490    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366513    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxpcp\" (UniqueName: \"kubernetes.io/projected/73007daa-d2c1-4772-84ff-16f19af37d04-kube-api-access-vxpcp\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-tuned\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366543    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-k8s-cni-cncf-io\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366559    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-node-log\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-env-overrides\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366627    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t9fm\" (UniqueName: \"kubernetes.io/projected/27367355-5031-4ebc-91a8-14a4752f9b45-kube-api-access-5t9fm\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f92c236d-3ba9-4890-bcb0-992227a203a9-serviceca\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366679    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-multus\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366717    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-socket-dir-parent\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366744    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-os-release\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.366768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366766    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-system-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366790    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-multus-certs\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366819    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysconfig\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-kubelet\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-multus-certs\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366869    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-socket-dir-parent\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366894    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-system-cni-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366932    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-log-socket\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366976    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-cni-binary-copy\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.366991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367023    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-kubelet\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-os-release\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovn-node-metrics-cert\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-sys-fs\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367088    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-kubelet\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367222 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblg4\" (UniqueName: \"kubernetes.io/projected/f92c236d-3ba9-4890-bcb0-992227a203a9-kube-api-access-bblg4\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367170    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2xz\" (UniqueName: \"kubernetes.io/projected/923dadc4-29a6-4dab-8426-f17d19e8698b-kube-api-access-6z2xz\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367201    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-hostroot\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367232    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-kube-api-access-lfj94\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367267    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-hostroot\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-systemd-units\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367301    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-device-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f92c236d-3ba9-4890-bcb0-992227a203a9-host\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367438    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367460    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-cnibin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367497    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-slash\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-modprobe-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367590    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-cnibin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-sys\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367634    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmj5\" (UniqueName: \"kubernetes.io/projected/d905fc66-89b0-42b1-b3d7-45ca2eb26546-kube-api-access-wwmj5\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367695    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.367958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367743    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-bin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-run\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367872    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-cnibin\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367880    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-var-lib-cni-bin\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367916    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-netns\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367929    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-cnibin\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfbce04-8ff9-4957-90b2-03634bfd0f92-host-slash\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.367993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368011    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-host-run-netns\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-socket-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368040    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-registration-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368076    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-etc-kubernetes\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-config\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368117    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2162043b-4854-47bd-8cbb-15e63d7bec35-agent-certs\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368133    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368149    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-etc-kubernetes\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.368705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-kubernetes\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2nc\" (UniqueName: \"kubernetes.io/projected/bdfbce04-8ff9-4957-90b2-03634bfd0f92-kube-api-access-ll2nc\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.368217    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-etc-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368254    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.368329    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:20.868278784 +0000 UTC m=+3.119791221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-bin\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368386    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-system-cni-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-conf\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-systemd\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368455    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-lib-modules\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368474    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/923dadc4-29a6-4dab-8426-f17d19e8698b-system-cni-dir\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdfbce04-8ff9-4957-90b2-03634bfd0f92-iptables-alerter-script\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-ovn\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368537    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkp9\" (UniqueName: \"kubernetes.io/projected/31ed2e73-a1eb-4782-9801-3844ca64dd6d-kube-api-access-8rkp9\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368560    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368581    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-multus-daemon-config\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368608    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368634    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-netns\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-var-lib-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368710    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-conf-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368754    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-multus-conf-dir\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368789    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2162043b-4854-47bd-8cbb-15e63d7bec35-konnectivity-ca\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-host\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-tmp\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.368950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-script-lib\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-etc-selinux\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369029    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-os-release\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-systemd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73007daa-d2c1-4772-84ff-16f19af37d04-multus-daemon-config\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369103    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/923dadc4-29a6-4dab-8426-f17d19e8698b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.369976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369160    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73007daa-d2c1-4772-84ff-16f19af37d04-os-release\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.370559 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.369364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2162043b-4854-47bd-8cbb-15e63d7bec35-konnectivity-ca\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.371973 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.371953    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2162043b-4854-47bd-8cbb-15e63d7bec35-agent-certs\") pod \"konnectivity-agent-2282w\" (UID: \"2162043b-4854-47bd-8cbb-15e63d7bec35\") " pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.375900 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.375882    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:20.375900 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.375902    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:20.376060 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.375915    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:20.376060 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.375962    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:20.875945372 +0000 UTC m=+3.127457797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:20.377641 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.377611    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxpcp\" (UniqueName: \"kubernetes.io/projected/73007daa-d2c1-4772-84ff-16f19af37d04-kube-api-access-vxpcp\") pod \"multus-zx4s6\" (UID: \"73007daa-d2c1-4772-84ff-16f19af37d04\") " pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.378155 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.378136    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfj94\" (UniqueName: \"kubernetes.io/projected/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-kube-api-access-lfj94\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.378342 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.378321    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2xz\" (UniqueName: \"kubernetes.io/projected/923dadc4-29a6-4dab-8426-f17d19e8698b-kube-api-access-6z2xz\") pod \"multus-additional-cni-plugins-b5d2r\" (UID: \"923dadc4-29a6-4dab-8426-f17d19e8698b\") " pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.390002 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.389959    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" event={"ID":"12ba3cafa5e44bfecf51edb64109fc5d","Type":"ContainerStarted","Data":"c80043e4baa1a8443128254f071b4261787356b25ba423e37359de8d86d2c99a"}
May 21 18:05:20.390952 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.390934    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"aa416b0fcab06364ab4a6f9b3d393aed","Type":"ContainerStarted","Data":"7cf47e1864777d0b9f7b9797b1fff30199359772a2ef8cd965b9ca2f7179fd52"}
May 21 18:05:20.470366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470267    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-var-lib-kubelet\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.470366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470300    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-netd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470323    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-tuned\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.470366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470345    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-node-log\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470382    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-var-lib-kubelet\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-node-log\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470417    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-env-overrides\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470437    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t9fm\" (UniqueName: \"kubernetes.io/projected/27367355-5031-4ebc-91a8-14a4752f9b45-kube-api-access-5t9fm\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f92c236d-3ba9-4890-bcb0-992227a203a9-serviceca\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470473    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysconfig\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470500    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-kubelet\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470410    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-netd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470542    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-kubelet\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470578    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysconfig\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470624    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-log-socket\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.470679 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470670    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470703    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470732    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovn-node-metrics-cert\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470740    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470757    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-sys-fs\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470779    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470783    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bblg4\" (UniqueName: \"kubernetes.io/projected/f92c236d-3ba9-4890-bcb0-992227a203a9-kube-api-access-bblg4\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470821    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-systemd-units\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470847    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-device-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470872    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f92c236d-3ba9-4890-bcb0-992227a203a9-host\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470897    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-slash\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470924    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470949    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-modprobe-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f92c236d-3ba9-4890-bcb0-992227a203a9-serviceca\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470973    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-sys\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470998    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmj5\" (UniqueName: \"kubernetes.io/projected/d905fc66-89b0-42b1-b3d7-45ca2eb26546-kube-api-access-wwmj5\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470703    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-log-socket\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.471300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471005    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-sys-fs\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.470946    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-env-overrides\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471008    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-slash\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471047    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471059    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-systemd-units\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f92c236d-3ba9-4890-bcb0-992227a203a9-host\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471231    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-run\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471262    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfbce04-8ff9-4957-90b2-03634bfd0f92-host-slash\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471294    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-sys\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471302    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-run\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471289    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471353    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-socket-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471361    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdfbce04-8ff9-4957-90b2-03634bfd0f92-host-slash\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471382    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-modprobe-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471390    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471353    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-device-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471380    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-registration-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471430    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-registration-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471448    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-config\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471470    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-socket-dir\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471516    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-kubernetes\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471544    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471570    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2nc\" (UniqueName: \"kubernetes.io/projected/bdfbce04-8ff9-4957-90b2-03634bfd0f92-kube-api-access-ll2nc\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471596    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-etc-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471624    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-bin\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471672    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-conf\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-systemd\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471719    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-d\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471723    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-lib-modules\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471767    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdfbce04-8ff9-4957-90b2-03634bfd0f92-iptables-alerter-script\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471794    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-ovn\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471819    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkp9\" (UniqueName: \"kubernetes.io/projected/31ed2e73-a1eb-4782-9801-3844ca64dd6d-kube-api-access-8rkp9\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471858    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-etc-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471896    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-config\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471908    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-netns\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.472912 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471919    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-systemd\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471933    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-var-lib-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471958    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-kubernetes\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471961    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-host\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471965    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-cni-bin\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471965    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-sysctl-conf\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471822    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-lib-modules\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.471995    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-tmp\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472002    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-host-run-netns\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472052    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-ovn\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472056    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d905fc66-89b0-42b1-b3d7-45ca2eb26546-host\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472100    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-script-lib\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472130    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-etc-selinux\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472183    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-systemd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472241    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27367355-5031-4ebc-91a8-14a4752f9b45-etc-selinux\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472288    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-var-lib-openvswitch\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472335    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31ed2e73-a1eb-4782-9801-3844ca64dd6d-run-systemd\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472526    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdfbce04-8ff9-4957-90b2-03634bfd0f92-iptables-alerter-script\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.473693 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.472752    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovnkube-script-lib\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.474171 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.473004    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-etc-tuned\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.474171 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.473630    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31ed2e73-a1eb-4782-9801-3844ca64dd6d-ovn-node-metrics-cert\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.474537 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.474516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d905fc66-89b0-42b1-b3d7-45ca2eb26546-tmp\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.478713 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.478646    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblg4\" (UniqueName: \"kubernetes.io/projected/f92c236d-3ba9-4890-bcb0-992227a203a9-kube-api-access-bblg4\") pod \"node-ca-jcg4d\" (UID: \"f92c236d-3ba9-4890-bcb0-992227a203a9\") " pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.479085 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.479067    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t9fm\" (UniqueName: \"kubernetes.io/projected/27367355-5031-4ebc-91a8-14a4752f9b45-kube-api-access-5t9fm\") pod \"aws-ebs-csi-driver-node-l284p\" (UID: \"27367355-5031-4ebc-91a8-14a4752f9b45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.479282 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.479263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmj5\" (UniqueName: \"kubernetes.io/projected/d905fc66-89b0-42b1-b3d7-45ca2eb26546-kube-api-access-wwmj5\") pod \"tuned-kbw8z\" (UID: \"d905fc66-89b0-42b1-b3d7-45ca2eb26546\") " pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.479699 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.479680    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2nc\" (UniqueName: \"kubernetes.io/projected/bdfbce04-8ff9-4957-90b2-03634bfd0f92-kube-api-access-ll2nc\") pod \"iptables-alerter-bqqvk\" (UID: \"bdfbce04-8ff9-4957-90b2-03634bfd0f92\") " pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.480369 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.480352    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkp9\" (UniqueName: \"kubernetes.io/projected/31ed2e73-a1eb-4782-9801-3844ca64dd6d-kube-api-access-8rkp9\") pod \"ovnkube-node-5vpsl\" (UID: \"31ed2e73-a1eb-4782-9801-3844ca64dd6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.558441 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.558405    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5d2r"
May 21 18:05:20.567126 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.567106    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zx4s6"
May 21 18:05:20.575875 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.575850    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:20.581491 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.581472    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqqvk"
May 21 18:05:20.588090 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.588073    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:20.594706 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.594685    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p"
May 21 18:05:20.601250 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.601230    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jcg4d"
May 21 18:05:20.608762 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.608745    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbw8z"
May 21 18:05:20.875642 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.875558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:20.875813 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.875735    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:20.875813 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.875799    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:21.875779102 +0000 UTC m=+4.127291531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:20.976313 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:20.976281    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:20.976442 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.976424    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:20.976442 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.976438    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:20.976514 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.976448    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:20.976514 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:20.976496    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:21.976479822 +0000 UTC m=+4.227992243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:20.996591 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:20.996550    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92c236d_3ba9_4890_bcb0_992227a203a9.slice/crio-230390e7e7003e1ed57288f2fe3993cf61e94aa6ee697b9c56b91dcb60727d88 WatchSource:0}: Error finding container 230390e7e7003e1ed57288f2fe3993cf61e94aa6ee697b9c56b91dcb60727d88: Status 404 returned error can't find the container with id 230390e7e7003e1ed57288f2fe3993cf61e94aa6ee697b9c56b91dcb60727d88
May 21 18:05:20.997496 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:20.997467    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ed2e73_a1eb_4782_9801_3844ca64dd6d.slice/crio-92c2a10cf1f7aa51fdf9c51cff69c077e52bd6b1f3c2afd48153c77f1aa3bdbe WatchSource:0}: Error finding container 92c2a10cf1f7aa51fdf9c51cff69c077e52bd6b1f3c2afd48153c77f1aa3bdbe: Status 404 returned error can't find the container with id 92c2a10cf1f7aa51fdf9c51cff69c077e52bd6b1f3c2afd48153c77f1aa3bdbe
May 21 18:05:20.998286 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:20.998257    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd905fc66_89b0_42b1_b3d7_45ca2eb26546.slice/crio-608f3dd66f16d26730780c4dbfd0757daf98faf9ed1de72b978a7b9d35d8fab2 WatchSource:0}: Error finding container 608f3dd66f16d26730780c4dbfd0757daf98faf9ed1de72b978a7b9d35d8fab2: Status 404 returned error can't find the container with id 608f3dd66f16d26730780c4dbfd0757daf98faf9ed1de72b978a7b9d35d8fab2
May 21 18:05:20.999190 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:20.999126    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27367355_5031_4ebc_91a8_14a4752f9b45.slice/crio-6bd816e8176c36793ed103586ed67d7ba733965dc9c26d967c4e44bd0c1f4cda WatchSource:0}: Error finding container 6bd816e8176c36793ed103586ed67d7ba733965dc9c26d967c4e44bd0c1f4cda: Status 404 returned error can't find the container with id 6bd816e8176c36793ed103586ed67d7ba733965dc9c26d967c4e44bd0c1f4cda
May 21 18:05:20.999782 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:20.999713    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2162043b_4854_47bd_8cbb_15e63d7bec35.slice/crio-a3b293d8575ed3985caea99907cd5f14658f4785be2bd142e28d4a6fd0f3c459 WatchSource:0}: Error finding container a3b293d8575ed3985caea99907cd5f14658f4785be2bd142e28d4a6fd0f3c459: Status 404 returned error can't find the container with id a3b293d8575ed3985caea99907cd5f14658f4785be2bd142e28d4a6fd0f3c459
May 21 18:05:21.002106 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:21.001713    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923dadc4_29a6_4dab_8426_f17d19e8698b.slice/crio-aa255f9e0c91216a0044db648c39b961f1783ea3a9089064dbbb7e806b318c8b WatchSource:0}: Error finding container aa255f9e0c91216a0044db648c39b961f1783ea3a9089064dbbb7e806b318c8b: Status 404 returned error can't find the container with id aa255f9e0c91216a0044db648c39b961f1783ea3a9089064dbbb7e806b318c8b
May 21 18:05:21.003447 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:21.003427    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73007daa_d2c1_4772_84ff_16f19af37d04.slice/crio-ca723e5748f7b9a184c115d06c2e861e4bcd762593e682c236b7ad1bfd9d3e7c WatchSource:0}: Error finding container ca723e5748f7b9a184c115d06c2e861e4bcd762593e682c236b7ad1bfd9d3e7c: Status 404 returned error can't find the container with id ca723e5748f7b9a184c115d06c2e861e4bcd762593e682c236b7ad1bfd9d3e7c
May 21 18:05:21.004059 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:21.004028    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfbce04_8ff9_4957_90b2_03634bfd0f92.slice/crio-aeb4f25be68a1f9d5acc45df1d37ae2787cfbe7ef8f5fa96d7579e610a90616a WatchSource:0}: Error finding container aeb4f25be68a1f9d5acc45df1d37ae2787cfbe7ef8f5fa96d7579e610a90616a: Status 404 returned error can't find the container with id aeb4f25be68a1f9d5acc45df1d37ae2787cfbe7ef8f5fa96d7579e610a90616a
May 21 18:05:21.296949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.296919    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:00:19 +0000 UTC" deadline="2027-12-18 22:10:31.173719832 +0000 UTC"
May 21 18:05:21.296949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.296947    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13828h5m9.876776259s"
May 21 18:05:21.386176 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.386147    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:21.386318 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.386274    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:21.397093 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.397061    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jcg4d" event={"ID":"f92c236d-3ba9-4890-bcb0-992227a203a9","Type":"ContainerStarted","Data":"230390e7e7003e1ed57288f2fe3993cf61e94aa6ee697b9c56b91dcb60727d88"}
May 21 18:05:21.400098 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.400071    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" event={"ID":"12ba3cafa5e44bfecf51edb64109fc5d","Type":"ContainerStarted","Data":"b1ad9df6c234dc94c5d5243241d69d139a5670ddb3e186d4107c6e5bf1bbf327"}
May 21 18:05:21.406935 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.406894    2557 generic.go:358] "Generic (PLEG): container finished" podID="aa416b0fcab06364ab4a6f9b3d393aed" containerID="e2f8df4f4c3b26f39b6cb4dbb64537b68ebedf6e3eaa6b8bf80d03d06737fc18" exitCode=0
May 21 18:05:21.407021 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.406965    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"aa416b0fcab06364ab4a6f9b3d393aed","Type":"ContainerDied","Data":"e2f8df4f4c3b26f39b6cb4dbb64537b68ebedf6e3eaa6b8bf80d03d06737fc18"}
May 21 18:05:21.409561 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.409539    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqqvk" event={"ID":"bdfbce04-8ff9-4957-90b2-03634bfd0f92","Type":"ContainerStarted","Data":"aeb4f25be68a1f9d5acc45df1d37ae2787cfbe7ef8f5fa96d7579e610a90616a"}
May 21 18:05:21.413891 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.413841    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zx4s6" event={"ID":"73007daa-d2c1-4772-84ff-16f19af37d04","Type":"ContainerStarted","Data":"ca723e5748f7b9a184c115d06c2e861e4bcd762593e682c236b7ad1bfd9d3e7c"}
May 21 18:05:21.416482 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.415111    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerStarted","Data":"aa255f9e0c91216a0044db648c39b961f1783ea3a9089064dbbb7e806b318c8b"}
May 21 18:05:21.418724 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.418699    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p" event={"ID":"27367355-5031-4ebc-91a8-14a4752f9b45","Type":"ContainerStarted","Data":"6bd816e8176c36793ed103586ed67d7ba733965dc9c26d967c4e44bd0c1f4cda"}
May 21 18:05:21.422440 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.422418    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"92c2a10cf1f7aa51fdf9c51cff69c077e52bd6b1f3c2afd48153c77f1aa3bdbe"}
May 21 18:05:21.431443 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.431401    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbw8z" event={"ID":"d905fc66-89b0-42b1-b3d7-45ca2eb26546","Type":"ContainerStarted","Data":"608f3dd66f16d26730780c4dbfd0757daf98faf9ed1de72b978a7b9d35d8fab2"}
May 21 18:05:21.431601 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.431563    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" podStartSLOduration=2.431549906 podStartE2EDuration="2.431549906s" podCreationTimestamp="2026-05-21 18:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:05:21.415394254 +0000 UTC m=+3.666906698" watchObservedRunningTime="2026-05-21 18:05:21.431549906 +0000 UTC m=+3.683062349"
May 21 18:05:21.437680 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.437644    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2282w" event={"ID":"2162043b-4854-47bd-8cbb-15e63d7bec35","Type":"ContainerStarted","Data":"a3b293d8575ed3985caea99907cd5f14658f4785be2bd142e28d4a6fd0f3c459"}
May 21 18:05:21.887459 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.886842    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:21.887459 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.886984    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:21.887459 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.887047    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:23.887028457 +0000 UTC m=+6.138540885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:21.987389 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:21.987302    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:21.987557 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.987498    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:21.987557 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.987531    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:21.987557 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.987545    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:21.987752 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:21.987639    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:23.98761962 +0000 UTC m=+6.239132046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:22.389992 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:22.389489    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:22.389992 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:22.389626    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:22.476805 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:22.476744    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"aa416b0fcab06364ab4a6f9b3d393aed","Type":"ContainerStarted","Data":"7ce927a5a9c900592812208e9cd233c02dfc2c9126208c5cb1b17c20e800c925"}
May 21 18:05:22.490098 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:22.490043    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" podStartSLOduration=3.490026272 podStartE2EDuration="3.490026272s" podCreationTimestamp="2026-05-21 18:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:05:22.489771194 +0000 UTC m=+4.741283638" watchObservedRunningTime="2026-05-21 18:05:22.490026272 +0000 UTC m=+4.741538715"
May 21 18:05:23.389691 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.386550    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:23.389691 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:23.386678    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:23.463458 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.463424    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-sl8cj"]
May 21 18:05:23.466245 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.466222    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.469021 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.468999    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jjd96\""
May 21 18:05:23.469275 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.469259    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 18:05:23.469440 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.469424    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 18:05:23.504495 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.504278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65df7f68-f12d-48f3-acf4-34e06ea221a2-hosts-file\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.504495 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.504327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65df7f68-f12d-48f3-acf4-34e06ea221a2-tmp-dir\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.504495 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.504400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccxq\" (UniqueName: \"kubernetes.io/projected/65df7f68-f12d-48f3-acf4-34e06ea221a2-kube-api-access-sccxq\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.604890 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.604766    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sccxq\" (UniqueName: \"kubernetes.io/projected/65df7f68-f12d-48f3-acf4-34e06ea221a2-kube-api-access-sccxq\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.604890 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.604826    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65df7f68-f12d-48f3-acf4-34e06ea221a2-hosts-file\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.604890 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.604864    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65df7f68-f12d-48f3-acf4-34e06ea221a2-tmp-dir\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.605294 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.605198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65df7f68-f12d-48f3-acf4-34e06ea221a2-tmp-dir\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.605935 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.605547    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65df7f68-f12d-48f3-acf4-34e06ea221a2-hosts-file\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.617432 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.617385    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccxq\" (UniqueName: \"kubernetes.io/projected/65df7f68-f12d-48f3-acf4-34e06ea221a2-kube-api-access-sccxq\") pod \"node-resolver-sl8cj\" (UID: \"65df7f68-f12d-48f3-acf4-34e06ea221a2\") " pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.781472 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.781385    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sl8cj"
May 21 18:05:23.907269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:23.907236    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:23.907426 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:23.907382    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:23.907500 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:23.907439    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:27.907421531 +0000 UTC m=+10.158933954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:24.008639 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:24.008400    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:24.008639 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:24.008587    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:24.008865 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:24.008671    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:24.008865 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:24.008688    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:24.008865 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:24.008742    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:28.008723105 +0000 UTC m=+10.260235534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:24.387160 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:24.386559    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:24.387160 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:24.386720    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:25.386649 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:25.386610    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:25.387099 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:25.386789    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:26.096128 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.096097    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hx4b4"]
May 21 18:05:26.098906 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.098873    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.099036 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.098968    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:26.225650 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.225613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-dbus\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.225847 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.225791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-kubelet-config\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.225910 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.225864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.326955 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.326904    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.327136 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.326963    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-dbus\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.327136 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.327036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-kubelet-config\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.327136 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.327051    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:26.327136 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.327119    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:26.827101741 +0000 UTC m=+9.078614167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:26.327336 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.327156    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-kubelet-config\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.327336 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.327221    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3672563a-2a58-41ef-b74b-6b0804e55d2c-dbus\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.387355 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.387102    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:26.387355 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.387275    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:26.831700 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:26.831581    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:26.831867 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.831795    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:26.831941 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:26.831877    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:27.831858726 +0000 UTC m=+10.083371152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:27.386544 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:27.386243    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:27.386544 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:27.386382    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:27.838855 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:27.838763    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:27.839301 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:27.838951    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:27.839301 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:27.839014    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:29.838996063 +0000 UTC m=+12.090508489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:27.939752 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:27.939713    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:27.939924 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:27.939862    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:27.939996 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:27.939933    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:35.939913692 +0000 UTC m=+18.191426117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:28.040300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:28.040258    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:28.040489 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.040453    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:28.040556 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.040503    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:28.040556 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.040517    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:28.040649 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.040578    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:36.04055876 +0000 UTC m=+18.292071195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:28.388262 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:28.387818    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:28.388262 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.387936    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:28.388262 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:28.388063    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:28.388262 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:28.388176    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:29.386283 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:29.386249    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:29.386766 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:29.386390    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:29.853372 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:29.853254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:29.853536 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:29.853462    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:29.853600 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:29.853536    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:33.853517557 +0000 UTC m=+16.105029992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:30.386382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:30.386346    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:30.386839 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:30.386482    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:30.386839 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:30.386547    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:30.386839 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:30.386695    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:31.386613 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:31.386573    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:31.387076 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:31.386727    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:32.386544 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:32.386511    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:32.386727 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:32.386548    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:32.386727 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:32.386667    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:32.387071 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:32.386787    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:33.386492 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:33.386459    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:33.386686 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:33.386586    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:33.885984 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:33.885897    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:33.886405 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:33.886054    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:33.886405 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:33.886110    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:41.886094598 +0000 UTC m=+24.137607038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:34.386098 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:34.386069    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:34.386098 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:34.386085    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:34.386266 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:34.386168    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:34.386308 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:34.386291    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:35.386624 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:35.386589    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:35.387231 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:35.386723    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:36.001792 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:36.001761    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:36.001971 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.001868    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:36.001971 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.001927    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:52.001910984 +0000 UTC m=+34.253423423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:36.102754 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:36.102725    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:36.102917 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.102896    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:36.102977 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.102921    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:36.102977 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.102935    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:36.103092 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.102993    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:52.102974056 +0000 UTC m=+34.354486491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:36.386569 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:36.386475    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:36.386770 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.386636    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:36.386770 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:36.386714    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:36.387161 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:36.386837    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:37.386160 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:37.386124    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:37.386313 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:37.386256    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:38.387757 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:38.387716    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:38.388173 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:38.387836    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:38.388173 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:38.387931    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:38.388173 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:38.388042    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:38.727731 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:38.727375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65df7f68_f12d_48f3_acf4_34e06ea221a2.slice/crio-b1345e55fa84039708c4a2d3aa2f6bce3ecef58461c0a2480dcd1b14872611d9 WatchSource:0}: Error finding container b1345e55fa84039708c4a2d3aa2f6bce3ecef58461c0a2480dcd1b14872611d9: Status 404 returned error can't find the container with id b1345e55fa84039708c4a2d3aa2f6bce3ecef58461c0a2480dcd1b14872611d9
May 21 18:05:39.386393 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.386231    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:39.386488 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:39.386468    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:39.504425 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.504395    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zx4s6" event={"ID":"73007daa-d2c1-4772-84ff-16f19af37d04","Type":"ContainerStarted","Data":"df663f877ae47274f9ff85dc7f0f364344ab74379a91aa89a97c7b35367b62d0"}
May 21 18:05:39.505921 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.505895    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="270c4e24552dcdc41a78fcd041ba0d64b1d549eab6cb3c2b74835da203696890" exitCode=0
May 21 18:05:39.506018 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.505949    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"270c4e24552dcdc41a78fcd041ba0d64b1d549eab6cb3c2b74835da203696890"}
May 21 18:05:39.507331 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.507312    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p" event={"ID":"27367355-5031-4ebc-91a8-14a4752f9b45","Type":"ContainerStarted","Data":"6d77656f011c2df9c26966316af732a60e7c90233d72cfe5096d8f716652def1"}
May 21 18:05:39.509647 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.509626    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"111a877d5a7cb8a4af18c057a27949235b4d766d4575ef31738efc3f612c0bab"}
May 21 18:05:39.509752 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.509669    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"1a89ed1b2050295528b184e34dcfc21e7292b6dc42b096d6d1ba81458300b299"}
May 21 18:05:39.509752 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.509684    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"17f92c2d8dbe54857fbf08b86d77252987b36489ca7468528b53ed3d6c5e019c"}
May 21 18:05:39.509752 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.509695    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"8b28b1bd454bed5986ad46e0e1c80297276fb999550bc28fe7e31caf65fc5e9c"}
May 21 18:05:39.509752 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.509707    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"9790b72c23c4634fe27140821859dc62a78ffc7f977e023e12ec668251f68a02"}
May 21 18:05:39.510816 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.510797    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sl8cj" event={"ID":"65df7f68-f12d-48f3-acf4-34e06ea221a2","Type":"ContainerStarted","Data":"ef2556196b90c842f5e00e1a5b7c3e8a13bf855d40999e642d9b32db1b11f5b9"}
May 21 18:05:39.510900 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.510823    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sl8cj" event={"ID":"65df7f68-f12d-48f3-acf4-34e06ea221a2","Type":"ContainerStarted","Data":"b1345e55fa84039708c4a2d3aa2f6bce3ecef58461c0a2480dcd1b14872611d9"}
May 21 18:05:39.512059 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.512038    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbw8z" event={"ID":"d905fc66-89b0-42b1-b3d7-45ca2eb26546","Type":"ContainerStarted","Data":"5b806746d93d92845c6d98818bf2f579393a8ebd7d9a3e89f801beebff5a40f6"}
May 21 18:05:39.513115 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.513096    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2282w" event={"ID":"2162043b-4854-47bd-8cbb-15e63d7bec35","Type":"ContainerStarted","Data":"302b957c1e41e544b5a53cd4cb96f07f7ffd3e6258bd312e995a6521ec8da753"}
May 21 18:05:39.514264 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.514246    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jcg4d" event={"ID":"f92c236d-3ba9-4890-bcb0-992227a203a9","Type":"ContainerStarted","Data":"84b9cdf116c6e5ad4f24806fdbe49ee2d2dd81307839f199ac51f25c203c5e02"}
May 21 18:05:39.519909 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.518556    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zx4s6" podStartSLOduration=3.7290231069999997 podStartE2EDuration="21.518540883s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.005123505 +0000 UTC m=+3.256635939" lastFinishedPulling="2026-05-21 18:05:38.79464128 +0000 UTC m=+21.046153715" observedRunningTime="2026-05-21 18:05:39.518155609 +0000 UTC m=+21.769668052" watchObservedRunningTime="2026-05-21 18:05:39.518540883 +0000 UTC m=+21.770053325"
May 21 18:05:39.530887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.530854    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbw8z" podStartSLOduration=3.77674401 podStartE2EDuration="21.530843948s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.000308146 +0000 UTC m=+3.251820600" lastFinishedPulling="2026-05-21 18:05:38.754408119 +0000 UTC m=+21.005920538" observedRunningTime="2026-05-21 18:05:39.530781927 +0000 UTC m=+21.782294371" watchObservedRunningTime="2026-05-21 18:05:39.530843948 +0000 UTC m=+21.782356389"
May 21 18:05:39.548154 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.548117    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-sl8cj" podStartSLOduration=16.548106389 podStartE2EDuration="16.548106389s" podCreationTimestamp="2026-05-21 18:05:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:05:39.547811049 +0000 UTC m=+21.799323505" watchObservedRunningTime="2026-05-21 18:05:39.548106389 +0000 UTC m=+21.799618831"
May 21 18:05:39.598336 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:39.598289    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2282w" podStartSLOduration=8.463550349 podStartE2EDuration="21.598276116s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.00258092 +0000 UTC m=+3.254093345" lastFinishedPulling="2026-05-21 18:05:34.137306686 +0000 UTC m=+16.388819112" observedRunningTime="2026-05-21 18:05:39.597724634 +0000 UTC m=+21.849237076" watchObservedRunningTime="2026-05-21 18:05:39.598276116 +0000 UTC m=+21.849788561"
May 21 18:05:40.277206 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.277177    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 18:05:40.327876 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.327793    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:05:40.277201589Z","UUID":"d7aa1b40-7f8f-46c9-80dd-9b8800fd162d","Handler":null,"Name":"","Endpoint":""}
May 21 18:05:40.329381 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.329359    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 18:05:40.329490 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.329389    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 18:05:40.386496 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.386433    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:40.386621 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.386444    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:40.386621 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:40.386573    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:40.386737 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:40.386638    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:40.517547 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.517508    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqqvk" event={"ID":"bdfbce04-8ff9-4957-90b2-03634bfd0f92","Type":"ContainerStarted","Data":"91dc4a8c7b8b2af35ebf98741970e1c81abeb7a523a9c3700b28c643e69dbccf"}
May 21 18:05:40.519361 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.519331    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p" event={"ID":"27367355-5031-4ebc-91a8-14a4752f9b45","Type":"ContainerStarted","Data":"8ae50378170260ea754f86ad34ec502313662254b403f45f0f460096a906bb3e"}
May 21 18:05:40.522074 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.522049    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"fa5f60d253b6942e8c70d7864c4c77ef8645c0a73f43e2c128bb163b3f9784f1"}
May 21 18:05:40.530110 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.530064    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bqqvk" podStartSLOduration=4.783143097 podStartE2EDuration="22.530049639s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.005585796 +0000 UTC m=+3.257098223" lastFinishedPulling="2026-05-21 18:05:38.752492345 +0000 UTC m=+21.004004765" observedRunningTime="2026-05-21 18:05:40.529961246 +0000 UTC m=+22.781473687" watchObservedRunningTime="2026-05-21 18:05:40.530049639 +0000 UTC m=+22.781562094"
May 21 18:05:40.530528 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:40.530498    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jcg4d" podStartSLOduration=4.801849414 podStartE2EDuration="22.530489435s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:20.99806299 +0000 UTC m=+3.249575412" lastFinishedPulling="2026-05-21 18:05:38.726702995 +0000 UTC m=+20.978215433" observedRunningTime="2026-05-21 18:05:39.611297587 +0000 UTC m=+21.862810030" watchObservedRunningTime="2026-05-21 18:05:40.530489435 +0000 UTC m=+22.782001896"
May 21 18:05:41.387012 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:41.386977    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:41.387167 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:41.387105    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:41.526629 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:41.526502    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p" event={"ID":"27367355-5031-4ebc-91a8-14a4752f9b45","Type":"ContainerStarted","Data":"c0d146853f4fdcdac34f449d343b18b22a7511f09bbe1abba6834e7535e8aa8d"}
May 21 18:05:41.554007 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:41.553943    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l284p" podStartSLOduration=3.30331167 podStartE2EDuration="23.553926548s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.001825653 +0000 UTC m=+3.253338076" lastFinishedPulling="2026-05-21 18:05:41.252440526 +0000 UTC m=+23.503952954" observedRunningTime="2026-05-21 18:05:41.553702528 +0000 UTC m=+23.805214971" watchObservedRunningTime="2026-05-21 18:05:41.553926548 +0000 UTC m=+23.805439021"
May 21 18:05:41.948505 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:41.948412    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:41.948683 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:41.948578    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 18:05:41.948746 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:41.948686    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret podName:3672563a-2a58-41ef-b74b-6b0804e55d2c nodeName:}" failed. No retries permitted until 2026-05-21 18:05:57.948666094 +0000 UTC m=+40.200178535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret") pod "global-pull-secret-syncer-hx4b4" (UID: "3672563a-2a58-41ef-b74b-6b0804e55d2c") : object "kube-system"/"original-pull-secret" not registered
May 21 18:05:42.386195 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:42.386116    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:42.386350 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:42.386252    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:42.386350 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:42.386330    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:42.386467 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:42.386432    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:42.532190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:42.532156    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"6293e4f2b10b7e8e00bc6b8f63ca7b5cc3dba9a0e94df612e48d24542e1c7800"}
May 21 18:05:42.672058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:42.671975    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:42.672965 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:42.672940    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:43.386319 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:43.386281    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:43.386498 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:43.386412    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:44.386233 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.386204    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:44.386635 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:44.386321    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:44.386635 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.386374    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:44.386635 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:44.386466    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:44.536724 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.536689    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="756f0d232aeb7d4f0b97351d0219f4e826ec9d4f8ec07c9194e7015b18163e2b" exitCode=0
May 21 18:05:44.536887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.536773    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"756f0d232aeb7d4f0b97351d0219f4e826ec9d4f8ec07c9194e7015b18163e2b"}
May 21 18:05:44.539803 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.539782    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" event={"ID":"31ed2e73-a1eb-4782-9801-3844ca64dd6d","Type":"ContainerStarted","Data":"cb4cb0f2161ac40ee72ecec794d9e278e3a0bdcd7e320014898271c3a5c6fe1a"}
May 21 18:05:44.540209 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.540192    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:44.540305 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.540216    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:44.555534 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.555509    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:44.603816 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:44.603770    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl" podStartSLOduration=8.587320979 podStartE2EDuration="26.603758326s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:20.999321721 +0000 UTC m=+3.250834148" lastFinishedPulling="2026-05-21 18:05:39.015759071 +0000 UTC m=+21.267271495" observedRunningTime="2026-05-21 18:05:44.603531004 +0000 UTC m=+26.855043448" watchObservedRunningTime="2026-05-21 18:05:44.603758326 +0000 UTC m=+26.855270767"
May 21 18:05:45.386504 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.386478    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:45.386836 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:45.386581    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:45.542212 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.541997    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:45.559571 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.559549    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:05:45.758070 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.757988    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hx4b4"]
May 21 18:05:45.758212 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.758134    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:45.758280 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:45.758244    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:45.761031 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.761005    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gk46d"]
May 21 18:05:45.761144 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.761087    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:45.761210 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:45.761173    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:45.763640 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.763616    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9pxr6"]
May 21 18:05:45.763739 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:45.763723    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:45.763822 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:45.763794    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:46.544888 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:46.544858    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="d2be0a0edfef4bafc6fed5982a541104e1b3f4adcb8ffd4a98c56c09698a65ad" exitCode=0
May 21 18:05:46.545553 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:46.544938    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"d2be0a0edfef4bafc6fed5982a541104e1b3f4adcb8ffd4a98c56c09698a65ad"}
May 21 18:05:47.386211 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:47.386177    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:47.386360 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:47.386295    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:47.386360 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:47.386315    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:47.386436 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:47.386287    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:47.386436 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:47.386381    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:47.386503 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:47.386468    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:48.550831 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:48.550797    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="72a96d05a17d3b57a6c905a066146c7427f4b6a4850d98589ae6e35effde9468" exitCode=0
May 21 18:05:48.551540 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:48.550862    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"72a96d05a17d3b57a6c905a066146c7427f4b6a4850d98589ae6e35effde9468"}
May 21 18:05:49.386541 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.386505    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:49.386541 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.386545    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:49.386797 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.386545    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:49.386797 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:49.386623    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:49.386797 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:49.386722    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:49.386928 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:49.386839    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:49.731889 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.731820    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:49.732290 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.731939    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 18:05:49.732470 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:49.732452    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2282w"
May 21 18:05:51.386229 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:51.386030    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:51.386682 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:51.386040    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:51.386682 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:51.386313    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gk46d" podUID="b13dd48b-7446-4cd4-92c0-28291ee02094"
May 21 18:05:51.386682 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:51.386412    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:05:51.386682 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:51.386040    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:51.386682 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:51.386496    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx4b4" podUID="3672563a-2a58-41ef-b74b-6b0804e55d2c"
May 21 18:05:52.030074 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.030028    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:52.030363 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.030181    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:52.030363 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.030250    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:24.030232621 +0000 UTC m=+66.281745041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:05:52.131065 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.131006    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:52.131252 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.131203    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:05:52.131252 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.131228    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:05:52.131252 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.131240    2557 projected.go:194] Error preparing data for projected volume kube-api-access-7tpwg for pod openshift-network-diagnostics/network-check-target-gk46d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:52.131419 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.131300    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg podName:b13dd48b-7446-4cd4-92c0-28291ee02094 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:24.131281008 +0000 UTC m=+66.382793442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tpwg" (UniqueName: "kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg") pod "network-check-target-gk46d" (UID: "b13dd48b-7446-4cd4-92c0-28291ee02094") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:05:52.539184 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.539156    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeReady"
May 21 18:05:52.539528 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.539270    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 18:05:52.572903 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.572869    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b5fb4495d-cbh2k"]
May 21 18:05:52.576858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.576755    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"]
May 21 18:05:52.576980 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.576886    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.582223 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.582146    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 18:05:52.582223 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.582154    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 18:05:52.582469 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.582268    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9p9qs\""
May 21 18:05:52.582469 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.582405    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 18:05:52.583581 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.583562    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"]
May 21 18:05:52.583741 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.583724    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.586502 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.586186    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 18:05:52.586676 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.586640    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"]
May 21 18:05:52.586774 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.586757    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.586887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.586871    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 18:05:52.586954 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.586886    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 18:05:52.587269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.587250    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 18:05:52.587356 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.587270    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 18:05:52.587356 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.587296    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 18:05:52.587750 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.587564    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 18:05:52.588577 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.588553    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 18:05:52.589076 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.589053    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 18:05:52.589553 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.589533    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7qxjp"]
May 21 18:05:52.592102 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.592085    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.592191 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.592116    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.595190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.594870    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 18:05:52.595190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.595068    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 18:05:52.595409 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.595379    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rc5s\""
May 21 18:05:52.595695 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.595632    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 18:05:52.595695 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.595644    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 18:05:52.596019 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.595929    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dgksq\""
May 21 18:05:52.596979 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.596715    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dqbvt"]
May 21 18:05:52.599749 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.599731    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"]
May 21 18:05:52.599852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.599756    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5fb4495d-cbh2k"]
May 21 18:05:52.599852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.599771    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"]
May 21 18:05:52.599852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.599781    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"]
May 21 18:05:52.600013 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.599876    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.602897 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.602878    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 18:05:52.603803 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.603519    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g5hp4\""
May 21 18:05:52.603803 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.603541    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 18:05:52.610472 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.610451    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qxjp"]
May 21 18:05:52.617174 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.616343    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqbvt"]
May 21 18:05:52.736276 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.736463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.736463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.736463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.736463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.736463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9rf\" (UniqueName: \"kubernetes.io/projected/495f0e6d-31d5-40ea-8b22-e05a585795e7-kube-api-access-4m9rf\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pv8\" (UniqueName: \"kubernetes.io/projected/8aefe2ca-5570-488d-ba33-ee1184bddead-kube-api-access-w2pv8\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c44ccb-de29-4978-827c-6de3142a2802-tmp-dir\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcjxn\" (UniqueName: \"kubernetes.io/projected/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-kube-api-access-mcjxn\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.736712 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/495f0e6d-31d5-40ea-8b22-e05a585795e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81c44ccb-de29-4978-827c-6de3142a2802-config-volume\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47b6z\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfzg\" (UniqueName: \"kubernetes.io/projected/d9326801-05c4-498c-95dc-ab38bc97e358-kube-api-access-drfzg\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qgc8\" (UniqueName: \"kubernetes.io/projected/81c44ccb-de29-4978-827c-6de3142a2802-kube-api-access-4qgc8\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736897    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495f0e6d-31d5-40ea-8b22-e05a585795e7-tmp\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.736951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9326801-05c4-498c-95dc-ab38bc97e358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.737050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.737008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.737430 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.737116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.838048 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.837971    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.838048 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838008    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.838048 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838027    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9rf\" (UniqueName: \"kubernetes.io/projected/495f0e6d-31d5-40ea-8b22-e05a585795e7-kube-api-access-4m9rf\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.838317 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838060    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.838317 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.838138    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:05:52.838317 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.838220    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:53.338197001 +0000 UTC m=+35.589709441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:05:52.838528 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838506    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pv8\" (UniqueName: \"kubernetes.io/projected/8aefe2ca-5570-488d-ba33-ee1184bddead-kube-api-access-w2pv8\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.838642 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838619    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c44ccb-de29-4978-827c-6de3142a2802-tmp-dir\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.838795 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838701    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcjxn\" (UniqueName: \"kubernetes.io/projected/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-kube-api-access-mcjxn\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.838795 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838746    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.838795 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838750    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/495f0e6d-31d5-40ea-8b22-e05a585795e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838845    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838874    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81c44ccb-de29-4978-827c-6de3142a2802-config-volume\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838907    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838935    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47b6z\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838945    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81c44ccb-de29-4978-827c-6de3142a2802-tmp-dir\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.838969 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838962    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drfzg\" (UniqueName: \"kubernetes.io/projected/d9326801-05c4-498c-95dc-ab38bc97e358-kube-api-access-drfzg\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.838988    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qgc8\" (UniqueName: \"kubernetes.io/projected/81c44ccb-de29-4978-827c-6de3142a2802-kube-api-access-4qgc8\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839013    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495f0e6d-31d5-40ea-8b22-e05a585795e7-tmp\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839069    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9326801-05c4-498c-95dc-ab38bc97e358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839098    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839133    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839158    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839183    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839208    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.839314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839230    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.840140 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.839907    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81c44ccb-de29-4978-827c-6de3142a2802-config-volume\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.840140 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.838939    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:05:52.840140 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.839974    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:05:52.840140 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.840122    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:05:52.840356 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.840256    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:53.340160605 +0000 UTC m=+35.591673039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:05:52.840495 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.840468    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495f0e6d-31d5-40ea-8b22-e05a585795e7-tmp\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.841221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.840734    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.841221 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:52.840810    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:05:53.340785458 +0000 UTC m=+35.592297896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:05:52.841221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.840834    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.842129 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.842093    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.843566 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.843521    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.845738 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.845019    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.845738 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.845532    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-ca\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.845738 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.845642    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.847749 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.847610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/495f0e6d-31d5-40ea-8b22-e05a585795e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.848249 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.848186    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.848353 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.848244    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9326801-05c4-498c-95dc-ab38bc97e358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.849267 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.848860    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.849267 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.849068    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.849267 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.849155    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pv8\" (UniqueName: \"kubernetes.io/projected/8aefe2ca-5570-488d-ba33-ee1184bddead-kube-api-access-w2pv8\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:52.850183 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.850160    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9rf\" (UniqueName: \"kubernetes.io/projected/495f0e6d-31d5-40ea-8b22-e05a585795e7-kube-api-access-4m9rf\") pod \"klusterlet-addon-workmgr-574b489ffd-z9bbb\" (UID: \"495f0e6d-31d5-40ea-8b22-e05a585795e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.850510 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.850492    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47b6z\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.851755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.851536    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcjxn\" (UniqueName: \"kubernetes.io/projected/bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e-kube-api-access-mcjxn\") pod \"cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk\" (UID: \"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.851755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.851643    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qgc8\" (UniqueName: \"kubernetes.io/projected/81c44ccb-de29-4978-827c-6de3142a2802-kube-api-access-4qgc8\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:52.851755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.851717    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:52.852077 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.852060    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfzg\" (UniqueName: \"kubernetes.io/projected/d9326801-05c4-498c-95dc-ab38bc97e358-kube-api-access-drfzg\") pod \"managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl\" (UID: \"d9326801-05c4-498c-95dc-ab38bc97e358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:52.913686 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.913640    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:05:52.923441 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.923420    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:05:52.935263 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:52.935234    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"
May 21 18:05:53.345934 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.345905    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:53.346121 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.345969    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:53.346121 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.346042    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:53.346121 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346072    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346070    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346159    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:54.346138311 +0000 UTC m=+36.597650730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346204    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:05:54.346190548 +0000 UTC m=+36.597702971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346153    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346225    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:05:53.346273 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:53.346248    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:54.346240889 +0000 UTC m=+36.597753308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:05:53.386378 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.386342    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:05:53.386531 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.386459    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:53.386531 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.386485    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:05:53.390953 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.390925    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:05:53.392166 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.392020    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6g8fq\""
May 21 18:05:53.392166 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.392031    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r49hb\""
May 21 18:05:53.392166 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.392066    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 18:05:53.392166 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.392094    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:05:53.392166 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:53.392020    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:05:54.354680 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.354589    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:54.354680 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.354670    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.354716    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354768    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354789    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354832    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354862    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:56.354846251 +0000 UTC m=+38.606358671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354882    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:05:56.354868179 +0000 UTC m=+38.606380603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354832    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:05:54.355141 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:54.354913    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:05:56.35490464 +0000 UTC m=+38.606417096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:05:54.911986 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.911955    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl"]
May 21 18:05:54.915055 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.915031    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"]
May 21 18:05:54.919547 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:54.919528    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"]
May 21 18:05:55.046273 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:55.046213    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9326801_05c4_498c_95dc_ab38bc97e358.slice/crio-2facd0e4948bf1151b383861f8e446e7f7c6df1cb251c1dead9330879cf95e66 WatchSource:0}: Error finding container 2facd0e4948bf1151b383861f8e446e7f7c6df1cb251c1dead9330879cf95e66: Status 404 returned error can't find the container with id 2facd0e4948bf1151b383861f8e446e7f7c6df1cb251c1dead9330879cf95e66
May 21 18:05:55.046728 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:55.046703    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495f0e6d_31d5_40ea_8b22_e05a585795e7.slice/crio-42c86091057d332ce713d16529a0b6df604103824d29f9bf9151a80a4a48bb40 WatchSource:0}: Error finding container 42c86091057d332ce713d16529a0b6df604103824d29f9bf9151a80a4a48bb40: Status 404 returned error can't find the container with id 42c86091057d332ce713d16529a0b6df604103824d29f9bf9151a80a4a48bb40
May 21 18:05:55.047437 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:05:55.047408    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbcd6cb3_5b19_40b5_acda_d4ac4a0c751e.slice/crio-fd61d43770dc4ccf4602e0cafe12e68952941b25524d1b1e8e977ef518f38605 WatchSource:0}: Error finding container fd61d43770dc4ccf4602e0cafe12e68952941b25524d1b1e8e977ef518f38605: Status 404 returned error can't find the container with id fd61d43770dc4ccf4602e0cafe12e68952941b25524d1b1e8e977ef518f38605
May 21 18:05:55.564159 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:55.564129    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" event={"ID":"495f0e6d-31d5-40ea-8b22-e05a585795e7","Type":"ContainerStarted","Data":"42c86091057d332ce713d16529a0b6df604103824d29f9bf9151a80a4a48bb40"}
May 21 18:05:55.565138 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:55.565114    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerStarted","Data":"fd61d43770dc4ccf4602e0cafe12e68952941b25524d1b1e8e977ef518f38605"}
May 21 18:05:55.566068 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:55.566009    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl" event={"ID":"d9326801-05c4-498c-95dc-ab38bc97e358","Type":"ContainerStarted","Data":"2facd0e4948bf1151b383861f8e446e7f7c6df1cb251c1dead9330879cf95e66"}
May 21 18:05:55.568344 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:55.568324    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="e6370223fb0e9e12163c0a61547f87a0fe23d63662ab628ba2155a9d0aae1810" exitCode=0
May 21 18:05:55.568439 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:55.568365    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"e6370223fb0e9e12163c0a61547f87a0fe23d63662ab628ba2155a9d0aae1810"}
May 21 18:05:56.373156 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:56.373122    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:05:56.373347 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:56.373197    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:05:56.373347 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373257    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:05:56.373347 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:56.373272    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:05:56.373347 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373317    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:06:00.373297608 +0000 UTC m=+42.624810041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:05:56.373563 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373355    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:05:56.373563 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373367    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:05:56.373563 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373400    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:00.373389132 +0000 UTC m=+42.624901567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:05:56.373563 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373465    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:05:56.373563 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:05:56.373524    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:00.373510843 +0000 UTC m=+42.625023263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:05:56.579145 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:56.579105    2557 generic.go:358] "Generic (PLEG): container finished" podID="923dadc4-29a6-4dab-8426-f17d19e8698b" containerID="b65582209f4214bfcb913f0f09cf058a33f4db5b5da0c8dcaa10a2d7519fe4b8" exitCode=0
May 21 18:05:56.579722 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:56.579182    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerDied","Data":"b65582209f4214bfcb913f0f09cf058a33f4db5b5da0c8dcaa10a2d7519fe4b8"}
May 21 18:05:57.588287 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:57.588253    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" event={"ID":"923dadc4-29a6-4dab-8426-f17d19e8698b","Type":"ContainerStarted","Data":"d86424c84cf07aaf60f71cf2c2824b602105a1162f9e96d76919675c4c804ac5"}
May 21 18:05:57.612364 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:57.612318    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b5d2r" podStartSLOduration=5.524741903 podStartE2EDuration="39.612303872s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:05:21.002886843 +0000 UTC m=+3.254399262" lastFinishedPulling="2026-05-21 18:05:55.09044881 +0000 UTC m=+37.341961231" observedRunningTime="2026-05-21 18:05:57.611523864 +0000 UTC m=+39.863036306" watchObservedRunningTime="2026-05-21 18:05:57.612303872 +0000 UTC m=+39.863816296"
May 21 18:05:57.986193 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:57.986091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:57.990529 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:57.990501    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3672563a-2a58-41ef-b74b-6b0804e55d2c-original-pull-secret\") pod \"global-pull-secret-syncer-hx4b4\" (UID: \"3672563a-2a58-41ef-b74b-6b0804e55d2c\") " pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:05:58.203987 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:05:58.203950    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx4b4"
May 21 18:06:00.407671 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:00.407633    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:00.407729    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:00.407777    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407788    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407856    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:08.407834951 +0000 UTC m=+50.659347392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407864    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407876    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407896    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407906    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:06:08.407896183 +0000 UTC m=+50.659408617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:06:00.408078 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:00.407941    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:08.407924736 +0000 UTC m=+50.659437169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:06:03.163516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.163419    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hx4b4"]
May 21 18:06:03.166242 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:06:03.166210    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3672563a_2a58_41ef_b74b_6b0804e55d2c.slice/crio-66a58da10cc0ee8503d1ab62909427739acdc562adb5c4204d3adf97d4825c17 WatchSource:0}: Error finding container 66a58da10cc0ee8503d1ab62909427739acdc562adb5c4204d3adf97d4825c17: Status 404 returned error can't find the container with id 66a58da10cc0ee8503d1ab62909427739acdc562adb5c4204d3adf97d4825c17
May 21 18:06:03.600573 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.600541    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl" event={"ID":"d9326801-05c4-498c-95dc-ab38bc97e358","Type":"ContainerStarted","Data":"3bb114b1dac67f9b998c59d14e3b7b61277d76864e75869238c8f888bd553db1"}
May 21 18:06:03.601779 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.601753    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" event={"ID":"495f0e6d-31d5-40ea-8b22-e05a585795e7","Type":"ContainerStarted","Data":"84fcd4dfb27b15784ee9c8e7748cd8940a5430e5d5d31823e7daab266c60d0a9"}
May 21 18:06:03.601943 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.601927    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:06:03.603094 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.603060    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerStarted","Data":"e35fe4ef6f0c807e07ccd0440b269b9a5cf4798018ac25c9a1493996e64765a0"}
May 21 18:06:03.603783 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.603760    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:06:03.604129 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.604106    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hx4b4" event={"ID":"3672563a-2a58-41ef-b74b-6b0804e55d2c","Type":"ContainerStarted","Data":"66a58da10cc0ee8503d1ab62909427739acdc562adb5c4204d3adf97d4825c17"}
May 21 18:06:03.616459 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.616417    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl" podStartSLOduration=9.636255802 podStartE2EDuration="17.616403601s" podCreationTimestamp="2026-05-21 18:05:46 +0000 UTC" firstStartedPulling="2026-05-21 18:05:55.065478742 +0000 UTC m=+37.316991176" lastFinishedPulling="2026-05-21 18:06:03.045626541 +0000 UTC m=+45.297138975" observedRunningTime="2026-05-21 18:06:03.615087827 +0000 UTC m=+45.866600270" watchObservedRunningTime="2026-05-21 18:06:03.616403601 +0000 UTC m=+45.867916047"
May 21 18:06:03.629795 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:03.629756    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" podStartSLOduration=9.648103721 podStartE2EDuration="17.629744249s" podCreationTimestamp="2026-05-21 18:05:46 +0000 UTC" firstStartedPulling="2026-05-21 18:05:55.065120566 +0000 UTC m=+37.316632995" lastFinishedPulling="2026-05-21 18:06:03.046761096 +0000 UTC m=+45.298273523" observedRunningTime="2026-05-21 18:06:03.629219709 +0000 UTC m=+45.880732151" watchObservedRunningTime="2026-05-21 18:06:03.629744249 +0000 UTC m=+45.881256691"
May 21 18:06:08.472935 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:08.472907    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:08.472950    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:08.472977    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473054    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473066    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473080    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473071    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473117    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:06:24.473103998 +0000 UTC m=+66.724616419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473134    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:24.473123354 +0000 UTC m=+66.724635774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:06:08.473348 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:08.473144    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:24.4731393 +0000 UTC m=+66.724651720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:06:09.617167 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:09.617128    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerStarted","Data":"4efdf8e4cfc91102e16a51082802d16efdb526a5e454b94bb6496b60f62719ae"}
May 21 18:06:09.617167 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:09.617171    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerStarted","Data":"6a3a6c7e9f537a0f08819d48fcc0e4e66be6be2971d4433482c0dde1a79ced2a"}
May 21 18:06:09.618298 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:09.618275    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hx4b4" event={"ID":"3672563a-2a58-41ef-b74b-6b0804e55d2c","Type":"ContainerStarted","Data":"60e813820ddd06f0d1e24501bb539de9e9ec79d673e082c8cf9c084b4d03f6bc"}
May 21 18:06:09.635671 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:09.635616    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" podStartSLOduration=10.161700498 podStartE2EDuration="23.635606193s" podCreationTimestamp="2026-05-21 18:05:46 +0000 UTC" firstStartedPulling="2026-05-21 18:05:55.065328685 +0000 UTC m=+37.316841105" lastFinishedPulling="2026-05-21 18:06:08.539234366 +0000 UTC m=+50.790746800" observedRunningTime="2026-05-21 18:06:09.634121623 +0000 UTC m=+51.885634070" watchObservedRunningTime="2026-05-21 18:06:09.635606193 +0000 UTC m=+51.887118634"
May 21 18:06:09.648718 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:09.648675    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hx4b4" podStartSLOduration=38.281996776 podStartE2EDuration="43.648642732s" podCreationTimestamp="2026-05-21 18:05:26 +0000 UTC" firstStartedPulling="2026-05-21 18:06:03.168215759 +0000 UTC m=+45.419728185" lastFinishedPulling="2026-05-21 18:06:08.534861717 +0000 UTC m=+50.786374141" observedRunningTime="2026-05-21 18:06:09.647979459 +0000 UTC m=+51.899491901" watchObservedRunningTime="2026-05-21 18:06:09.648642732 +0000 UTC m=+51.900155173"
May 21 18:06:17.560015 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:17.559985    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vpsl"
May 21 18:06:24.088536 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.088496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:06:24.091249 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.091233    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:06:24.099176 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.099162    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:06:24.099238 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.099218    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:07:28.0992024 +0000 UTC m=+130.350714827 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : secret "metrics-daemon-secret" not found
May 21 18:06:24.188995 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.188931    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:06:24.191951 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.191927    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:06:24.202866 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.202837    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:06:24.213470 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.213443    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tpwg\" (UniqueName: \"kubernetes.io/projected/b13dd48b-7446-4cd4-92c0-28291ee02094-kube-api-access-7tpwg\") pod \"network-check-target-gk46d\" (UID: \"b13dd48b-7446-4cd4-92c0-28291ee02094\") " pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:06:24.299808 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.299777    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r49hb\""
May 21 18:06:24.307944 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.307926    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:06:24.423729 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.423702    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gk46d"]
May 21 18:06:24.426332 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:06:24.426303    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13dd48b_7446_4cd4_92c0_28291ee02094.slice/crio-a0c06862ff882e16dd877c708bd6b43bdac5b47d8af4634d29318c8ad6f5bdbb WatchSource:0}: Error finding container a0c06862ff882e16dd877c708bd6b43bdac5b47d8af4634d29318c8ad6f5bdbb: Status 404 returned error can't find the container with id a0c06862ff882e16dd877c708bd6b43bdac5b47d8af4634d29318c8ad6f5bdbb
May 21 18:06:24.490582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.490549    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.490592    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.490616    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490721    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490746    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490729    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:06:24.490793 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490759    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:06:24.491035 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490800    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:56.490786816 +0000 UTC m=+98.742299237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:06:24.491035 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490814    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:06:56.490808324 +0000 UTC m=+98.742320743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:06:24.491035 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:24.490845    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:06:56.490825947 +0000 UTC m=+98.742338385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:06:24.650677 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:24.649544    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gk46d" event={"ID":"b13dd48b-7446-4cd4-92c0-28291ee02094","Type":"ContainerStarted","Data":"a0c06862ff882e16dd877c708bd6b43bdac5b47d8af4634d29318c8ad6f5bdbb"}
May 21 18:06:27.658101 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:27.658063    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gk46d" event={"ID":"b13dd48b-7446-4cd4-92c0-28291ee02094","Type":"ContainerStarted","Data":"fa48e225c7a6e36abb9ac9a4e10fd38c1c26f1dd5a58b14eff0b58ab84134d3e"}
May 21 18:06:27.658521 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:27.658182    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:06:27.673749 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:27.673706    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gk46d" podStartSLOduration=66.90339268 podStartE2EDuration="1m9.673692845s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:06:24.428166811 +0000 UTC m=+66.679679244" lastFinishedPulling="2026-05-21 18:06:27.19846697 +0000 UTC m=+69.449979409" observedRunningTime="2026-05-21 18:06:27.672889931 +0000 UTC m=+69.924402374" watchObservedRunningTime="2026-05-21 18:06:27.673692845 +0000 UTC m=+69.925205284"
May 21 18:06:56.531435 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:56.531390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:56.531467    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531536    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531612    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:08:00.531597162 +0000 UTC m=+162.783109585 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531544    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531734    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:56.531764    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531789    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:08:00.531774242 +0000 UTC m=+162.783286676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531841    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:06:56.532100 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:06:56.531878    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:08:00.531870214 +0000 UTC m=+162.783382643 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:06:58.663604 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:06:58.663576    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gk46d"
May 21 18:07:28.161778 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:07:28.161733    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:07:28.162257 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:28.161867    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:07:28.162257 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:28.161938    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs podName:fa94915c-fe1b-4cc6-a227-6c36aaac26f8 nodeName:}" failed. No retries permitted until 2026-05-21 18:09:30.1619211 +0000 UTC m=+252.413433524 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs") pod "network-metrics-daemon-9pxr6" (UID: "fa94915c-fe1b-4cc6-a227-6c36aaac26f8") : secret "metrics-daemon-secret" not found
May 21 18:07:55.591421 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:55.591341    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k" podUID="5d253dc9-ece2-42db-8dee-420230964da9"
May 21 18:07:55.630603 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:55.630575    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7qxjp" podUID="8aefe2ca-5570-488d-ba33-ee1184bddead"
May 21 18:07:55.648822 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:55.648786    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dqbvt" podUID="81c44ccb-de29-4978-827c-6de3142a2802"
May 21 18:07:55.863705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:07:55.863601    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:07:55.863705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:07:55.863615    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:07:55.863705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:07:55.863607    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqbvt"
May 21 18:07:56.410217 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:07:56.410179    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9pxr6" podUID="fa94915c-fe1b-4cc6-a227-6c36aaac26f8"
May 21 18:08:00.593427 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:00.593388    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:00.593440    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:00.593499    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") pod \"image-registry-7b5fb4495d-cbh2k\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") " pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593540    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593578    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593590    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5fb4495d-cbh2k: secret "image-registry-tls" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593606    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593616    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert podName:8aefe2ca-5570-488d-ba33-ee1184bddead nodeName:}" failed. No retries permitted until 2026-05-21 18:10:02.593598223 +0000 UTC m=+284.845110665 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert") pod "ingress-canary-7qxjp" (UID: "8aefe2ca-5570-488d-ba33-ee1184bddead") : secret "canary-serving-cert" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593633    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls podName:5d253dc9-ece2-42db-8dee-420230964da9 nodeName:}" failed. No retries permitted until 2026-05-21 18:10:02.593626383 +0000 UTC m=+284.845138802 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls") pod "image-registry-7b5fb4495d-cbh2k" (UID: "5d253dc9-ece2-42db-8dee-420230964da9") : secret "image-registry-tls" not found
May 21 18:08:00.593850 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:00.593671    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls podName:81c44ccb-de29-4978-827c-6de3142a2802 nodeName:}" failed. No retries permitted until 2026-05-21 18:10:02.593639415 +0000 UTC m=+284.845151834 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls") pod "dns-default-dqbvt" (UID: "81c44ccb-de29-4978-827c-6de3142a2802") : secret "dns-default-metrics-tls" not found
May 21 18:08:03.602475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.602427    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" podUID="495f0e6d-31d5-40ea-8b22-e05a585795e7" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused"
May 21 18:08:03.885089 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.885000    2557 generic.go:358] "Generic (PLEG): container finished" podID="495f0e6d-31d5-40ea-8b22-e05a585795e7" containerID="84fcd4dfb27b15784ee9c8e7748cd8940a5430e5d5d31823e7daab266c60d0a9" exitCode=1
May 21 18:08:03.885089 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.885074    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" event={"ID":"495f0e6d-31d5-40ea-8b22-e05a585795e7","Type":"ContainerDied","Data":"84fcd4dfb27b15784ee9c8e7748cd8940a5430e5d5d31823e7daab266c60d0a9"}
May 21 18:08:03.885431 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.885416    2557 scope.go:117] "RemoveContainer" containerID="84fcd4dfb27b15784ee9c8e7748cd8940a5430e5d5d31823e7daab266c60d0a9"
May 21 18:08:03.886369 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.886345    2557 generic.go:358] "Generic (PLEG): container finished" podID="d9326801-05c4-498c-95dc-ab38bc97e358" containerID="3bb114b1dac67f9b998c59d14e3b7b61277d76864e75869238c8f888bd553db1" exitCode=255
May 21 18:08:03.886457 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.886383    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl" event={"ID":"d9326801-05c4-498c-95dc-ab38bc97e358","Type":"ContainerDied","Data":"3bb114b1dac67f9b998c59d14e3b7b61277d76864e75869238c8f888bd553db1"}
May 21 18:08:03.886625 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:03.886612    2557 scope.go:117] "RemoveContainer" containerID="3bb114b1dac67f9b998c59d14e3b7b61277d76864e75869238c8f888bd553db1"
May 21 18:08:04.663613 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:04.663586    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sl8cj_65df7f68-f12d-48f3-acf4-34e06ea221a2/dns-node-resolver/0.log"
May 21 18:08:04.890919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:04.890884    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d6cc759c4-qr7hl" event={"ID":"d9326801-05c4-498c-95dc-ab38bc97e358","Type":"ContainerStarted","Data":"b3b3bb622c769da599e134928bfe2ca92faf1009c4af2be21ee4037a2aaf1584"}
May 21 18:08:04.892410 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:04.892386    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb" event={"ID":"495f0e6d-31d5-40ea-8b22-e05a585795e7","Type":"ContainerStarted","Data":"346e08b4e5221a3fe0ed746b27c04002f7bf07712064f46941f3608f3f89b644"}
May 21 18:08:04.892609 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:04.892590    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:08:04.893225 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:04.893207    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-574b489ffd-z9bbb"
May 21 18:08:05.465536 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:05.465510    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jcg4d_f92c236d-3ba9-4890-bcb0-992227a203a9/node-ca/0.log"
May 21 18:08:09.386205 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:09.386123    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:08:27.841063 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.841031    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pl9q2"]
May 21 18:08:27.842900 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.842884    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:27.845444 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.845416    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 18:08:27.846418 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.846395    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 18:08:27.846507 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.846397    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 18:08:27.846599 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.846579    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wxqwq\""
May 21 18:08:27.846671 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.846608    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 18:08:27.855988 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.855968    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl9q2"]
May 21 18:08:27.993923 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.993895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-crio-socket\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:27.993923 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.993930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-data-volume\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:27.994134 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.993950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:27.994134 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.994024    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:27.994134 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:27.994062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f862r\" (UniqueName: \"kubernetes.io/projected/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-api-access-f862r\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094405    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-crio-socket\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094442    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-data-volume\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094462    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094674 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094486    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094674 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094535    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-crio-socket\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094674 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094582    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f862r\" (UniqueName: \"kubernetes.io/projected/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-api-access-f862r\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.094816 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.094799    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-data-volume\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.095055 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.095027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.096837 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.096816    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.103187 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.103164    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f862r\" (UniqueName: \"kubernetes.io/projected/3f1fdaa6-d9b0-4925-9041-eb48b50aba4e-kube-api-access-f862r\") pod \"insights-runtime-extractor-pl9q2\" (UID: \"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e\") " pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.151802 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.151784    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl9q2"
May 21 18:08:28.268667 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.268625    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl9q2"]
May 21 18:08:28.271288 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:08:28.271261    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1fdaa6_d9b0_4925_9041_eb48b50aba4e.slice/crio-6db6736f302fc40d2293ab8c4ba92b583cb5c6f3b9aafb6bbe5a70e08ea03c30 WatchSource:0}: Error finding container 6db6736f302fc40d2293ab8c4ba92b583cb5c6f3b9aafb6bbe5a70e08ea03c30: Status 404 returned error can't find the container with id 6db6736f302fc40d2293ab8c4ba92b583cb5c6f3b9aafb6bbe5a70e08ea03c30
May 21 18:08:28.948356 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.948328    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl9q2" event={"ID":"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e","Type":"ContainerStarted","Data":"0318b157814db1f21ab963c8945315896b6a54af719cab5c5c4c9c2d3d2a0110"}
May 21 18:08:28.948629 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:28.948367    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl9q2" event={"ID":"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e","Type":"ContainerStarted","Data":"6db6736f302fc40d2293ab8c4ba92b583cb5c6f3b9aafb6bbe5a70e08ea03c30"}
May 21 18:08:29.952519 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:29.952484    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl9q2" event={"ID":"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e","Type":"ContainerStarted","Data":"54cbdb540d68b71b90c6af2d9e6b005f8c94d49c06421028313292bbe8ca50a4"}
May 21 18:08:30.957189 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:30.957151    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl9q2" event={"ID":"3f1fdaa6-d9b0-4925-9041-eb48b50aba4e","Type":"ContainerStarted","Data":"87b36f4e0d97b9fbe4f4ccf1beebe873f8dd4003093ada1f871c593fb4cda14f"}
May 21 18:08:30.977275 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:30.977229    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pl9q2" podStartSLOduration=1.928826367 podStartE2EDuration="3.977216961s" podCreationTimestamp="2026-05-21 18:08:27 +0000 UTC" firstStartedPulling="2026-05-21 18:08:28.317820865 +0000 UTC m=+190.569333293" lastFinishedPulling="2026-05-21 18:08:30.366211452 +0000 UTC m=+192.617723887" observedRunningTime="2026-05-21 18:08:30.977169002 +0000 UTC m=+193.228681442" watchObservedRunningTime="2026-05-21 18:08:30.977216961 +0000 UTC m=+193.228729405"
May 21 18:08:40.124043 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.124009    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bsrcv"]
May 21 18:08:40.127059 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.127042    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.129835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.129814    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 18:08:40.130083 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130065    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 18:08:40.130173 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130067    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 18:08:40.130173 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130103    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 18:08:40.130961 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130937    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 18:08:40.131060 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130939    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 18:08:40.131060 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.130972    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h6hdg\""
May 21 18:08:40.275620 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-metrics-client-ca\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275620 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-root\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-wtmp\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-sys\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-textfile\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275984 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-tls\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.275984 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.275901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h644p\" (UniqueName: \"kubernetes.io/projected/dc3590f1-fe55-468d-88ae-975baf0b07d6-kube-api-access-h644p\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.376958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.376890    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-metrics-client-ca\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.376958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.376923    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-root\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.376958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.376949    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-wtmp\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.376974    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377011    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377030    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-sys\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377047    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-textfile\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377007    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-root\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377084    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-tls\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377124    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-wtmp\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377184    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h644p\" (UniqueName: \"kubernetes.io/projected/dc3590f1-fe55-468d-88ae-975baf0b07d6-kube-api-access-h644p\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377544 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377348    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3590f1-fe55-468d-88ae-975baf0b07d6-sys\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377544 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377429    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-textfile\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377624 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377544    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-metrics-client-ca\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.377624 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.377586    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.379237 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.379218    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-tls\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.379322 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.379254    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc3590f1-fe55-468d-88ae-975baf0b07d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.385508 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.385486    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h644p\" (UniqueName: \"kubernetes.io/projected/dc3590f1-fe55-468d-88ae-975baf0b07d6-kube-api-access-h644p\") pod \"node-exporter-bsrcv\" (UID: \"dc3590f1-fe55-468d-88ae-975baf0b07d6\") " pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.436020 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.435987    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsrcv"
May 21 18:08:40.443615 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:08:40.443585    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3590f1_fe55_468d_88ae_975baf0b07d6.slice/crio-126a69978ba4f67c79f195c500ed02490d3e18b88b1b70c5d5234f4bca7eb306 WatchSource:0}: Error finding container 126a69978ba4f67c79f195c500ed02490d3e18b88b1b70c5d5234f4bca7eb306: Status 404 returned error can't find the container with id 126a69978ba4f67c79f195c500ed02490d3e18b88b1b70c5d5234f4bca7eb306
May 21 18:08:40.981327 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:40.981288    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsrcv" event={"ID":"dc3590f1-fe55-468d-88ae-975baf0b07d6","Type":"ContainerStarted","Data":"126a69978ba4f67c79f195c500ed02490d3e18b88b1b70c5d5234f4bca7eb306"}
May 21 18:08:41.984625 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:41.984595    2557 generic.go:358] "Generic (PLEG): container finished" podID="dc3590f1-fe55-468d-88ae-975baf0b07d6" containerID="35f662d22a292722e4635481751aaf664eacf39b3a3bff5bb898b757d5adc183" exitCode=0
May 21 18:08:41.984994 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:41.984680    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsrcv" event={"ID":"dc3590f1-fe55-468d-88ae-975baf0b07d6","Type":"ContainerDied","Data":"35f662d22a292722e4635481751aaf664eacf39b3a3bff5bb898b757d5adc183"}
May 21 18:08:42.914902 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:42.914852    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" podUID="bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:08:42.989599 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:42.989561    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsrcv" event={"ID":"dc3590f1-fe55-468d-88ae-975baf0b07d6","Type":"ContainerStarted","Data":"67a294ec20e50c53338431b544b1ed2d1b0187a9cd78847d296951e9fb9af98e"}
May 21 18:08:42.989970 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:42.989609    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsrcv" event={"ID":"dc3590f1-fe55-468d-88ae-975baf0b07d6","Type":"ContainerStarted","Data":"3bd7560b63a800ec9868f7990c4315cb39d7dbe74835efcbecc7764fe050f586"}
May 21 18:08:43.009847 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:43.009796    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bsrcv" podStartSLOduration=2.011086834 podStartE2EDuration="3.009783644s" podCreationTimestamp="2026-05-21 18:08:40 +0000 UTC" firstStartedPulling="2026-05-21 18:08:40.445476584 +0000 UTC m=+202.696989004" lastFinishedPulling="2026-05-21 18:08:41.444173391 +0000 UTC m=+203.695685814" observedRunningTime="2026-05-21 18:08:43.009086791 +0000 UTC m=+205.260599234" watchObservedRunningTime="2026-05-21 18:08:43.009783644 +0000 UTC m=+205.261296085"
May 21 18:08:49.451137 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:49.451099    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5fb4495d-cbh2k"]
May 21 18:08:49.451524 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:08:49.451322    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k" podUID="5d253dc9-ece2-42db-8dee-420230964da9"
May 21 18:08:50.011437 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.011409    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:08:50.015433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.015414    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:08:50.148064 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148035    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47b6z\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148085    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148104    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148127    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148167    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148202    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148235    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets\") pod \"5d253dc9-ece2-42db-8dee-420230964da9\" (UID: \"5d253dc9-ece2-42db-8dee-420230964da9\") "
May 21 18:08:50.148452 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148390    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:08:50.148560 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148463    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d253dc9-ece2-42db-8dee-420230964da9-ca-trust-extracted\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.148560 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148524    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:08:50.148887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.148854    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:08:50.150526 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.150496    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:08:50.150630 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.150538    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z" (OuterVolumeSpecName: "kube-api-access-47b6z") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "kube-api-access-47b6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:08:50.150630 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.150556    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:08:50.150630 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.150611    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5d253dc9-ece2-42db-8dee-420230964da9" (UID: "5d253dc9-ece2-42db-8dee-420230964da9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:08:50.249516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249486    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-trusted-ca\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.249516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249511    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-bound-sa-token\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.249709 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249525    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-image-registry-private-configuration\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.249709 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249539    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d253dc9-ece2-42db-8dee-420230964da9-registry-certificates\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.249709 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249552    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d253dc9-ece2-42db-8dee-420230964da9-installation-pull-secrets\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:50.249709 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:50.249565    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47b6z\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-kube-api-access-47b6z\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:51.014088 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:51.014056    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5fb4495d-cbh2k"
May 21 18:08:51.045409 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:51.045381    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5fb4495d-cbh2k"]
May 21 18:08:51.048564 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:51.048542    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b5fb4495d-cbh2k"]
May 21 18:08:51.156113 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:51.156083    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d253dc9-ece2-42db-8dee-420230964da9-registry-tls\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:08:52.389441 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:52.389410    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d253dc9-ece2-42db-8dee-420230964da9" path="/var/lib/kubelet/pods/5d253dc9-ece2-42db-8dee-420230964da9/volumes"
May 21 18:08:52.914949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:08:52.914912    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" podUID="bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:09:02.915330 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:02.915291    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" podUID="bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:09:02.915901 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:02.915373    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk"
May 21 18:09:02.915901 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:02.915862    2557 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4efdf8e4cfc91102e16a51082802d16efdb526a5e454b94bb6496b60f62719ae"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 18:09:02.915987 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:02.915922    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" podUID="bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e" containerName="service-proxy" containerID="cri-o://4efdf8e4cfc91102e16a51082802d16efdb526a5e454b94bb6496b60f62719ae" gracePeriod=30
May 21 18:09:03.045626 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:03.045596    2557 generic.go:358] "Generic (PLEG): container finished" podID="bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e" containerID="4efdf8e4cfc91102e16a51082802d16efdb526a5e454b94bb6496b60f62719ae" exitCode=2
May 21 18:09:03.045728 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:03.045640    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerDied","Data":"4efdf8e4cfc91102e16a51082802d16efdb526a5e454b94bb6496b60f62719ae"}
May 21 18:09:04.050337 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:04.050302    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcdc8dcdd-rjfzk" event={"ID":"bbcd6cb3-5b19-40b5-acda-d4ac4a0c751e","Type":"ContainerStarted","Data":"a0d56e142a4422ea475da765bbd2c7532e3fe742a8beea11bd7610f4b2206d71"}
May 21 18:09:18.645927 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:18.645899    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sl8cj_65df7f68-f12d-48f3-acf4-34e06ea221a2/dns-node-resolver/0.log"
May 21 18:09:30.224879 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:30.224831    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:09:30.227127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:30.227102    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa94915c-fe1b-4cc6-a227-6c36aaac26f8-metrics-certs\") pod \"network-metrics-daemon-9pxr6\" (UID: \"fa94915c-fe1b-4cc6-a227-6c36aaac26f8\") " pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:09:30.389376 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:30.389349    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6g8fq\""
May 21 18:09:30.397529 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:30.397503    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9pxr6"
May 21 18:09:30.517339 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:30.517272    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9pxr6"]
May 21 18:09:30.520285 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:09:30.520260    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa94915c_fe1b_4cc6_a227_6c36aaac26f8.slice/crio-2926a84c8bef69f940c574463d804c4ce3ed00e92b62de018f99ebff54c5c591 WatchSource:0}: Error finding container 2926a84c8bef69f940c574463d804c4ce3ed00e92b62de018f99ebff54c5c591: Status 404 returned error can't find the container with id 2926a84c8bef69f940c574463d804c4ce3ed00e92b62de018f99ebff54c5c591
May 21 18:09:31.113780 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:31.113747    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9pxr6" event={"ID":"fa94915c-fe1b-4cc6-a227-6c36aaac26f8","Type":"ContainerStarted","Data":"2926a84c8bef69f940c574463d804c4ce3ed00e92b62de018f99ebff54c5c591"}
May 21 18:09:32.117738 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:32.117698    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9pxr6" event={"ID":"fa94915c-fe1b-4cc6-a227-6c36aaac26f8","Type":"ContainerStarted","Data":"89b092b5f3f593738ac180bca27cfa4016e893fde7ff987d3299393c47704919"}
May 21 18:09:32.117738 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:32.117731    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9pxr6" event={"ID":"fa94915c-fe1b-4cc6-a227-6c36aaac26f8","Type":"ContainerStarted","Data":"10af1ce6238f9bf9cf9fe7da9ffb354508c75a35f9bff350b757fafcb2b7d509"}
May 21 18:09:32.145043 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:32.145003    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9pxr6" podStartSLOduration=253.113194593 podStartE2EDuration="4m14.14498721s" podCreationTimestamp="2026-05-21 18:05:18 +0000 UTC" firstStartedPulling="2026-05-21 18:09:30.522462019 +0000 UTC m=+252.773974440" lastFinishedPulling="2026-05-21 18:09:31.554254633 +0000 UTC m=+253.805767057" observedRunningTime="2026-05-21 18:09:32.144333495 +0000 UTC m=+254.395845941" watchObservedRunningTime="2026-05-21 18:09:32.14498721 +0000 UTC m=+254.396499655"
May 21 18:09:58.864236 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:09:58.864193    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dqbvt" podUID="81c44ccb-de29-4978-827c-6de3142a2802"
May 21 18:09:58.864236 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:09:58.864193    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7qxjp" podUID="8aefe2ca-5570-488d-ba33-ee1184bddead"
May 21 18:09:59.181792 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:59.181722    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqbvt"
May 21 18:09:59.181924 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:09:59.181721    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:10:02.637268 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.637239    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:10:02.637770 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.637274    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:10:02.639690 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.639645    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c44ccb-de29-4978-827c-6de3142a2802-metrics-tls\") pod \"dns-default-dqbvt\" (UID: \"81c44ccb-de29-4978-827c-6de3142a2802\") " pod="openshift-dns/dns-default-dqbvt"
May 21 18:10:02.639947 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.639922    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8aefe2ca-5570-488d-ba33-ee1184bddead-cert\") pod \"ingress-canary-7qxjp\" (UID: \"8aefe2ca-5570-488d-ba33-ee1184bddead\") " pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:10:02.785208 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.785182    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rc5s\""
May 21 18:10:02.786036 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.786021    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g5hp4\""
May 21 18:10:02.793032 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.793017    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqbvt"
May 21 18:10:02.793120 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.793028    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qxjp"
May 21 18:10:02.924928 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.924903    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqbvt"]
May 21 18:10:02.927394 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:10:02.927363    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c44ccb_de29_4978_827c_6de3142a2802.slice/crio-17deee0540ac6f16e649d9b5657a45d8f4725bfe4b82df1a8b0dec89f19fba81 WatchSource:0}: Error finding container 17deee0540ac6f16e649d9b5657a45d8f4725bfe4b82df1a8b0dec89f19fba81: Status 404 returned error can't find the container with id 17deee0540ac6f16e649d9b5657a45d8f4725bfe4b82df1a8b0dec89f19fba81
May 21 18:10:02.940218 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:02.940192    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qxjp"]
May 21 18:10:02.942749 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:10:02.942724    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aefe2ca_5570_488d_ba33_ee1184bddead.slice/crio-ba86ce0c9204f52ee5a85b9de1d77e792cb7e2a937da5ad84316c16bb4ee5994 WatchSource:0}: Error finding container ba86ce0c9204f52ee5a85b9de1d77e792cb7e2a937da5ad84316c16bb4ee5994: Status 404 returned error can't find the container with id ba86ce0c9204f52ee5a85b9de1d77e792cb7e2a937da5ad84316c16bb4ee5994
May 21 18:10:03.192917 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:03.192825    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qxjp" event={"ID":"8aefe2ca-5570-488d-ba33-ee1184bddead","Type":"ContainerStarted","Data":"ba86ce0c9204f52ee5a85b9de1d77e792cb7e2a937da5ad84316c16bb4ee5994"}
May 21 18:10:03.193701 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:03.193677    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqbvt" event={"ID":"81c44ccb-de29-4978-827c-6de3142a2802","Type":"ContainerStarted","Data":"17deee0540ac6f16e649d9b5657a45d8f4725bfe4b82df1a8b0dec89f19fba81"}
May 21 18:10:05.201413 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.201358    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qxjp" event={"ID":"8aefe2ca-5570-488d-ba33-ee1184bddead","Type":"ContainerStarted","Data":"4271c40db64a9ab482374a5ed0e5bb4b04cb085ac032dc99234b14e6376b919b"}
May 21 18:10:05.203198 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.203176    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqbvt" event={"ID":"81c44ccb-de29-4978-827c-6de3142a2802","Type":"ContainerStarted","Data":"d50c14d030b335bfecb24d17ab09149e3d21e6a527c66172ed5bb5005290cc37"}
May 21 18:10:05.203301 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.203202    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqbvt" event={"ID":"81c44ccb-de29-4978-827c-6de3142a2802","Type":"ContainerStarted","Data":"c34dc8071c9a2a744d2e8b02541fc09b9ce72896a6f875794c28b6322394c1fa"}
May 21 18:10:05.203361 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.203349    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dqbvt"
May 21 18:10:05.220424 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.220374    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7qxjp" podStartSLOduration=251.164155293 podStartE2EDuration="4m13.22035665s" podCreationTimestamp="2026-05-21 18:05:52 +0000 UTC" firstStartedPulling="2026-05-21 18:10:02.944446747 +0000 UTC m=+285.195959167" lastFinishedPulling="2026-05-21 18:10:05.000648079 +0000 UTC m=+287.252160524" observedRunningTime="2026-05-21 18:10:05.218965702 +0000 UTC m=+287.470478144" watchObservedRunningTime="2026-05-21 18:10:05.22035665 +0000 UTC m=+287.471869092"
May 21 18:10:05.236926 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:05.236881    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-dqbvt" podStartSLOduration=251.169976732 podStartE2EDuration="4m13.236868341s" podCreationTimestamp="2026-05-21 18:05:52 +0000 UTC" firstStartedPulling="2026-05-21 18:10:02.929234464 +0000 UTC m=+285.180746885" lastFinishedPulling="2026-05-21 18:10:04.996126069 +0000 UTC m=+287.247638494" observedRunningTime="2026-05-21 18:10:05.235871444 +0000 UTC m=+287.487383888" watchObservedRunningTime="2026-05-21 18:10:05.236868341 +0000 UTC m=+287.488381021"
May 21 18:10:15.208131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:15.208100    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dqbvt"
May 21 18:10:18.280307 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:10:18.280275    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 21 18:12:50.923627 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.923543    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"]
May 21 18:12:50.926556 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.926538    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:50.929232 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.929207    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 18:12:50.929352 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.929254    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6772f\""
May 21 18:12:50.930253 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.930233    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 18:12:50.937284 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:50.937265    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"]
May 21 18:12:51.016923 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.016895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxs8w\" (UniqueName: \"kubernetes.io/projected/3b3e8d56-49fa-4966-83af-5667d13254b3-kube-api-access-wxs8w\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.017079 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.016952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3e8d56-49fa-4966-83af-5667d13254b3-tmp\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.118162 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.118135    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxs8w\" (UniqueName: \"kubernetes.io/projected/3b3e8d56-49fa-4966-83af-5667d13254b3-kube-api-access-wxs8w\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.118279 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.118214    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3e8d56-49fa-4966-83af-5667d13254b3-tmp\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.118570 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.118547    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3e8d56-49fa-4966-83af-5667d13254b3-tmp\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.127597 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.127570    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxs8w\" (UniqueName: \"kubernetes.io/projected/3b3e8d56-49fa-4966-83af-5667d13254b3-kube-api-access-wxs8w\") pod \"openshift-lws-operator-bfc7f696d-sqr7k\" (UID: \"3b3e8d56-49fa-4966-83af-5667d13254b3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.235195 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.235147    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"
May 21 18:12:51.352913 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.352885    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k"]
May 21 18:12:51.355715 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:12:51.355691    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b3e8d56_49fa_4966_83af_5667d13254b3.slice/crio-2d03a9cce431813a9c435894a611f18d93d8c02669f7033a0e0d2260dd7dcb74 WatchSource:0}: Error finding container 2d03a9cce431813a9c435894a611f18d93d8c02669f7033a0e0d2260dd7dcb74: Status 404 returned error can't find the container with id 2d03a9cce431813a9c435894a611f18d93d8c02669f7033a0e0d2260dd7dcb74
May 21 18:12:51.357127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.357108    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:12:51.609038 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:51.609010    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k" event={"ID":"3b3e8d56-49fa-4966-83af-5667d13254b3","Type":"ContainerStarted","Data":"2d03a9cce431813a9c435894a611f18d93d8c02669f7033a0e0d2260dd7dcb74"}
May 21 18:12:54.618721 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:54.618690    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k" event={"ID":"3b3e8d56-49fa-4966-83af-5667d13254b3","Type":"ContainerStarted","Data":"f139fb2d885c7bef2d23a2024688c7c0a2baa7c5ec4197c7294aa70903ae5d2e"}
May 21 18:12:54.635353 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:12:54.635308    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sqr7k" podStartSLOduration=2.137369298 podStartE2EDuration="4.635293627s" podCreationTimestamp="2026-05-21 18:12:50 +0000 UTC" firstStartedPulling="2026-05-21 18:12:51.357292517 +0000 UTC m=+453.608804939" lastFinishedPulling="2026-05-21 18:12:53.855216846 +0000 UTC m=+456.106729268" observedRunningTime="2026-05-21 18:12:54.634212581 +0000 UTC m=+456.885725022" watchObservedRunningTime="2026-05-21 18:12:54.635293627 +0000 UTC m=+456.886806064"
May 21 18:13:13.739828 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.739795    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"]
May 21 18:13:13.742707 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.742688    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.748100 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.748077    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 18:13:13.748417 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.748402    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 18:13:13.748892 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.748569    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 18:13:13.748892 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.748628    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 18:13:13.749067 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.749050    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4x6lr\""
May 21 18:13:13.786135 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.786113    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"]
May 21 18:13:13.865564 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.865534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.865683 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.865578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.865727 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.865675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zks6j\" (UniqueName: \"kubernetes.io/projected/87db80f1-823a-4b33-a8ad-64625e37caad-kube-api-access-zks6j\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.966960 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.966932    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zks6j\" (UniqueName: \"kubernetes.io/projected/87db80f1-823a-4b33-a8ad-64625e37caad-kube-api-access-zks6j\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.967072 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.966973    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.967117 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.967094    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.969477 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.969448    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.969568 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.969448    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87db80f1-823a-4b33-a8ad-64625e37caad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:13.976977 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:13.976959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zks6j\" (UniqueName: \"kubernetes.io/projected/87db80f1-823a-4b33-a8ad-64625e37caad-kube-api-access-zks6j\") pod \"opendatahub-operator-controller-manager-6d88b9bb7c-t88v7\" (UID: \"87db80f1-823a-4b33-a8ad-64625e37caad\") " pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:14.051772 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:14.051750    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:14.196588 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:14.196564    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"]
May 21 18:13:14.198946 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:13:14.198920    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87db80f1_823a_4b33_a8ad_64625e37caad.slice/crio-b71692e58792cfdd1a97c6a62e9ba398f590d59d9acd815d0b380079ad1069d7 WatchSource:0}: Error finding container b71692e58792cfdd1a97c6a62e9ba398f590d59d9acd815d0b380079ad1069d7: Status 404 returned error can't find the container with id b71692e58792cfdd1a97c6a62e9ba398f590d59d9acd815d0b380079ad1069d7
May 21 18:13:14.668857 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:14.668814    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7" event={"ID":"87db80f1-823a-4b33-a8ad-64625e37caad","Type":"ContainerStarted","Data":"b71692e58792cfdd1a97c6a62e9ba398f590d59d9acd815d0b380079ad1069d7"}
May 21 18:13:17.678619 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:17.678587    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7" event={"ID":"87db80f1-823a-4b33-a8ad-64625e37caad","Type":"ContainerStarted","Data":"cb3015f98820f5f0f55d46644ae8779373cab7da905b023a091b6254482d3ecc"}
May 21 18:13:17.678984 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:17.678754    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:17.738253 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:17.738205    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7" podStartSLOduration=2.231031672 podStartE2EDuration="4.738191231s" podCreationTimestamp="2026-05-21 18:13:13 +0000 UTC" firstStartedPulling="2026-05-21 18:13:14.200771054 +0000 UTC m=+476.452283474" lastFinishedPulling="2026-05-21 18:13:16.70793061 +0000 UTC m=+478.959443033" observedRunningTime="2026-05-21 18:13:17.737007256 +0000 UTC m=+479.988519697" watchObservedRunningTime="2026-05-21 18:13:17.738191231 +0000 UTC m=+479.989703674"
May 21 18:13:23.981035 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.980997    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"]
May 21 18:13:23.985105 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.985086    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:23.993131 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.993110    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b2mbv\""
May 21 18:13:23.993254 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.993140    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 18:13:23.993254 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.993113    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 18:13:23.993254 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:23.993113    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 18:13:24.006688 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.006635    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"]
May 21 18:13:24.035758 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.035737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.035848 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.035779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9qz\" (UniqueName: \"kubernetes.io/projected/de4f69f6-2cfc-416e-aa75-ac593a55301a-kube-api-access-gb9qz\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.035848 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.035804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/de4f69f6-2cfc-416e-aa75-ac593a55301a-manager-config\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.035918 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.035877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-metrics-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.136843 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.136816    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-metrics-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.136951 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.136866    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.136951 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.136914    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9qz\" (UniqueName: \"kubernetes.io/projected/de4f69f6-2cfc-416e-aa75-ac593a55301a-kube-api-access-gb9qz\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.137055 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.136953    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/de4f69f6-2cfc-416e-aa75-ac593a55301a-manager-config\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.137532 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.137511    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/de4f69f6-2cfc-416e-aa75-ac593a55301a-manager-config\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.139373 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.139354    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.139435 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.139410    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/de4f69f6-2cfc-416e-aa75-ac593a55301a-metrics-cert\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.152003 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.151979    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9qz\" (UniqueName: \"kubernetes.io/projected/de4f69f6-2cfc-416e-aa75-ac593a55301a-kube-api-access-gb9qz\") pod \"lws-controller-manager-6fd5f56d79-7f5dx\" (UID: \"de4f69f6-2cfc-416e-aa75-ac593a55301a\") " pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.293511 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.293491    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:24.450710 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.450687    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"]
May 21 18:13:24.452412 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:13:24.452382    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4f69f6_2cfc_416e_aa75_ac593a55301a.slice/crio-4be8fb8fbadac6d865beeab5316fc778112fcbecaad5dde65d13a36d8310a761 WatchSource:0}: Error finding container 4be8fb8fbadac6d865beeab5316fc778112fcbecaad5dde65d13a36d8310a761: Status 404 returned error can't find the container with id 4be8fb8fbadac6d865beeab5316fc778112fcbecaad5dde65d13a36d8310a761
May 21 18:13:24.697408 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:24.697333    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx" event={"ID":"de4f69f6-2cfc-416e-aa75-ac593a55301a","Type":"ContainerStarted","Data":"4be8fb8fbadac6d865beeab5316fc778112fcbecaad5dde65d13a36d8310a761"}
May 21 18:13:26.704696 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:26.704612    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx" event={"ID":"de4f69f6-2cfc-416e-aa75-ac593a55301a","Type":"ContainerStarted","Data":"220d8360f3270029ad03511333a2020b95b0fd59f9fa9ad6d891ee5696e8dce1"}
May 21 18:13:26.705020 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:26.704827    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:13:26.731501 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:26.731453    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx" podStartSLOduration=1.7876045299999999 podStartE2EDuration="3.731440186s" podCreationTimestamp="2026-05-21 18:13:23 +0000 UTC" firstStartedPulling="2026-05-21 18:13:24.454079139 +0000 UTC m=+486.705591559" lastFinishedPulling="2026-05-21 18:13:26.39791478 +0000 UTC m=+488.649427215" observedRunningTime="2026-05-21 18:13:26.731246861 +0000 UTC m=+488.982759305" watchObservedRunningTime="2026-05-21 18:13:26.731440186 +0000 UTC m=+488.982952630"
May 21 18:13:28.683156 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:28.683127    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d88b9bb7c-t88v7"
May 21 18:13:37.709124 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:13:37.709089    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6fd5f56d79-7f5dx"
May 21 18:14:38.955582 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.955497    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"]
May 21 18:14:38.957469 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.957448    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:38.961422 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.961402    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 18:14:38.961922 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.961906    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 18:14:38.962450 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.962434    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ffkw6\""
May 21 18:14:38.962551 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.962466    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 18:14:38.974522 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:38.974499    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"]
May 21 18:14:39.045461 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045638 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045638 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045638 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28a6f1fd-3724-4f59-b310-fc12556f1482-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045638 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045872 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045872 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045872 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h54l\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-kube-api-access-2h54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.045872 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.045794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146365 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146325    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146365 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146369    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146589 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146499    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146589 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146552    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h54l\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-kube-api-access-2h54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146588    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146641    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146646    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146695    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.146723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146709    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.147000 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146764    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.147000 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146793    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28a6f1fd-3724-4f59-b310-fc12556f1482-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.147000 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146829    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.147000 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.146914    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.147412 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.147390    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28a6f1fd-3724-4f59-b310-fc12556f1482-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.148761 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.148741    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.149048 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.149032    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.155300 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.155274    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.155597 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.155580    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h54l\" (UniqueName: \"kubernetes.io/projected/28a6f1fd-3724-4f59-b310-fc12556f1482-kube-api-access-2h54l\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bszjkz\" (UID: \"28a6f1fd-3724-4f59-b310-fc12556f1482\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.267537 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.267456    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:39.393919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.393890    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"]
May 21 18:14:39.397646 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:14:39.397621    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a6f1fd_3724_4f59_b310_fc12556f1482.slice/crio-6b0eb637fe92885fc9348186a9d8141623ea94c7fc2469610966718851312740 WatchSource:0}: Error finding container 6b0eb637fe92885fc9348186a9d8141623ea94c7fc2469610966718851312740: Status 404 returned error can't find the container with id 6b0eb637fe92885fc9348186a9d8141623ea94c7fc2469610966718851312740
May 21 18:14:39.901669 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:39.901620    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz" event={"ID":"28a6f1fd-3724-4f59-b310-fc12556f1482","Type":"ContainerStarted","Data":"6b0eb637fe92885fc9348186a9d8141623ea94c7fc2469610966718851312740"}
May 21 18:14:41.810531 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:41.810492    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:14:41.810796 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:41.810580    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:14:41.810796 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:41.810628    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:14:41.909189 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:41.909144    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz" event={"ID":"28a6f1fd-3724-4f59-b310-fc12556f1482","Type":"ContainerStarted","Data":"e7d90e9e1cb6871ba414dfcce046a5cb6eaa32f2b9eadfe47ef420838027c517"}
May 21 18:14:41.931296 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:41.931249    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz" podStartSLOduration=1.521027619 podStartE2EDuration="3.931232523s" podCreationTimestamp="2026-05-21 18:14:38 +0000 UTC" firstStartedPulling="2026-05-21 18:14:39.400036661 +0000 UTC m=+561.651549082" lastFinishedPulling="2026-05-21 18:14:41.81024155 +0000 UTC m=+564.061753986" observedRunningTime="2026-05-21 18:14:41.929168962 +0000 UTC m=+564.180681409" watchObservedRunningTime="2026-05-21 18:14:41.931232523 +0000 UTC m=+564.182744966"
May 21 18:14:42.268120 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:42.268034    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:42.269359 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:42.269330    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused" start-of-body=
May 21 18:14:42.269502 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:42.269378    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz" podUID="28a6f1fd-3724-4f59-b310-fc12556f1482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.16:15021/healthz/ready\": dial tcp 10.132.0.16:15021: connect: connection refused"
May 21 18:14:43.272052 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:43.272023    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:43.916118 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:43.916083    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:14:43.920070 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:14:43.920043    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bszjkz"
May 21 18:15:05.690891 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.690851    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"]
May 21 18:15:05.701012 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.700990    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.703593 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.703572    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:15:05.704761 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.704737    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6hpxh\""
May 21 18:15:05.704852 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.704782    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:15:05.705550 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.705530    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"]
May 21 18:15:05.839435 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.839400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t92tg\" (UniqueName: \"kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.839561 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.839447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.940699 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.940645    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t92tg\" (UniqueName: \"kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.940858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.940806    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.941195 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.941148    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:05.952524 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:05.952504    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t92tg\" (UniqueName: \"kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:06.015030 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:06.015007    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:06.142698 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:06.142637    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"]
May 21 18:15:06.145461 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:06.145437    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d9f6b9_2b4a_43e8_ad73_0fb3d03aae4e.slice/crio-8051c9d3428464dc9ffcb042800960810e4d6c8da67cefffcc9c0a9e1d35e219 WatchSource:0}: Error finding container 8051c9d3428464dc9ffcb042800960810e4d6c8da67cefffcc9c0a9e1d35e219: Status 404 returned error can't find the container with id 8051c9d3428464dc9ffcb042800960810e4d6c8da67cefffcc9c0a9e1d35e219
May 21 18:15:06.975724 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:06.975688    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" event={"ID":"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e","Type":"ContainerStarted","Data":"8051c9d3428464dc9ffcb042800960810e4d6c8da67cefffcc9c0a9e1d35e219"}
May 21 18:15:10.450093 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.450062    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"]
May 21 18:15:10.453525 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.453498    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:10.456261 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.456223    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 18:15:10.456261 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.456224    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s5djz\""
May 21 18:15:10.463086 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.463063    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"]
May 21 18:15:10.577683 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.577635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62f4q\" (UniqueName: \"kubernetes.io/projected/f61b3b80-9967-41ef-a2ec-8ca21d4a46cd-kube-api-access-62f4q\") pod \"dns-operator-controller-manager-648d5c98bc-qjsrl\" (UID: \"f61b3b80-9967-41ef-a2ec-8ca21d4a46cd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:10.678102 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.678067    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62f4q\" (UniqueName: \"kubernetes.io/projected/f61b3b80-9967-41ef-a2ec-8ca21d4a46cd-kube-api-access-62f4q\") pod \"dns-operator-controller-manager-648d5c98bc-qjsrl\" (UID: \"f61b3b80-9967-41ef-a2ec-8ca21d4a46cd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:10.686995 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.686967    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62f4q\" (UniqueName: \"kubernetes.io/projected/f61b3b80-9967-41ef-a2ec-8ca21d4a46cd-kube-api-access-62f4q\") pod \"dns-operator-controller-manager-648d5c98bc-qjsrl\" (UID: \"f61b3b80-9967-41ef-a2ec-8ca21d4a46cd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:10.766007 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.765938    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:10.892942 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.892907    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"]
May 21 18:15:10.897711 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:10.897676    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61b3b80_9967_41ef_a2ec_8ca21d4a46cd.slice/crio-88a56b279b8b74eea1dcca1a2e48c1439209d96dd2da3ba3c7f40d0e1950c522 WatchSource:0}: Error finding container 88a56b279b8b74eea1dcca1a2e48c1439209d96dd2da3ba3c7f40d0e1950c522: Status 404 returned error can't find the container with id 88a56b279b8b74eea1dcca1a2e48c1439209d96dd2da3ba3c7f40d0e1950c522
May 21 18:15:10.990143 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.990095    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" event={"ID":"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e","Type":"ContainerStarted","Data":"26b3414aa3f272baa7a62e20900c867a7485a03e979f3b915eba3e35e1454b3f"}
May 21 18:15:10.990323 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.990301    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:10.991209 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:10.991188    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl" event={"ID":"f61b3b80-9967-41ef-a2ec-8ca21d4a46cd","Type":"ContainerStarted","Data":"88a56b279b8b74eea1dcca1a2e48c1439209d96dd2da3ba3c7f40d0e1950c522"}
May 21 18:15:11.032981 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:11.032890    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" podStartSLOduration=1.6559347679999998 podStartE2EDuration="6.032872946s" podCreationTimestamp="2026-05-21 18:15:05 +0000 UTC" firstStartedPulling="2026-05-21 18:15:06.147685126 +0000 UTC m=+588.399197553" lastFinishedPulling="2026-05-21 18:15:10.524623306 +0000 UTC m=+592.776135731" observedRunningTime="2026-05-21 18:15:11.030490374 +0000 UTC m=+593.282002829" watchObservedRunningTime="2026-05-21 18:15:11.032872946 +0000 UTC m=+593.284385389"
May 21 18:15:12.444229 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.444196    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"]
May 21 18:15:12.447707 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.447681    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:12.450234 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.450215    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-77lr6\""
May 21 18:15:12.457161 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.456398    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"]
May 21 18:15:12.591736 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.591702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8q44\" (UniqueName: \"kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44\") pod \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" (UID: \"337557b7-f11a-4300-ade0-4168369857f7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:12.692685 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.692637    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8q44\" (UniqueName: \"kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44\") pod \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" (UID: \"337557b7-f11a-4300-ade0-4168369857f7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:12.701883 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.701847    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8q44\" (UniqueName: \"kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44\") pod \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" (UID: \"337557b7-f11a-4300-ade0-4168369857f7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:12.760839 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.760804    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:12.917548 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.917520    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"]
May 21 18:15:12.919285 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:12.919250    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337557b7_f11a_4300_ade0_4168369857f7.slice/crio-2e9aeffd6606149237116f0b2892ab5177c93cf87677645f87eae3929f04405d WatchSource:0}: Error finding container 2e9aeffd6606149237116f0b2892ab5177c93cf87677645f87eae3929f04405d: Status 404 returned error can't find the container with id 2e9aeffd6606149237116f0b2892ab5177c93cf87677645f87eae3929f04405d
May 21 18:15:12.998998 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.998935    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl" event={"ID":"f61b3b80-9967-41ef-a2ec-8ca21d4a46cd","Type":"ContainerStarted","Data":"3fa62be282f97d1bd41f106d7d2bd9297188f628c3ca555ff03f32e49afc2c8c"}
May 21 18:15:12.999122 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.999034    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:13.000015 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:12.999993    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" event={"ID":"337557b7-f11a-4300-ade0-4168369857f7","Type":"ContainerStarted","Data":"2e9aeffd6606149237116f0b2892ab5177c93cf87677645f87eae3929f04405d"}
May 21 18:15:13.043312 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:13.043270    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl" podStartSLOduration=1.319635299 podStartE2EDuration="3.043259927s" podCreationTimestamp="2026-05-21 18:15:10 +0000 UTC" firstStartedPulling="2026-05-21 18:15:10.899595394 +0000 UTC m=+593.151107820" lastFinishedPulling="2026-05-21 18:15:12.623220026 +0000 UTC m=+594.874732448" observedRunningTime="2026-05-21 18:15:13.041853158 +0000 UTC m=+595.293365601" watchObservedRunningTime="2026-05-21 18:15:13.043259927 +0000 UTC m=+595.294772713"
May 21 18:15:15.007824 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:15.007788    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" event={"ID":"337557b7-f11a-4300-ade0-4168369857f7","Type":"ContainerStarted","Data":"0303da5fc298b62d454b72d9639074e5d5f69ad09dfd1f088c41d6444be96631"}
May 21 18:15:15.008190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:15.007844    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:15.024038 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:15.023991    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" podStartSLOduration=1.519698693 podStartE2EDuration="3.023977106s" podCreationTimestamp="2026-05-21 18:15:12 +0000 UTC" firstStartedPulling="2026-05-21 18:15:12.921781132 +0000 UTC m=+595.173293561" lastFinishedPulling="2026-05-21 18:15:14.426059548 +0000 UTC m=+596.677571974" observedRunningTime="2026-05-21 18:15:15.023407386 +0000 UTC m=+597.274919829" watchObservedRunningTime="2026-05-21 18:15:15.023977106 +0000 UTC m=+597.275489549"
May 21 18:15:21.997332 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:21.997301    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:23.790347 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.790308    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"]
May 21 18:15:23.793743 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.793722    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"
May 21 18:15:23.816457 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.816426    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"]
May 21 18:15:23.841086 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.841061    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"]
May 21 18:15:23.841247 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:15:23.841229    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kbg4w], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-kbg4w]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" podUID="a0f70144-4d6a-45af-adda-734656bcca8e"
May 21 18:15:23.858968 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.858939    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"]
May 21 18:15:23.876498 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.876458    2557 status_manager.go:919] "Failed to update status for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a0f70144-4d6a-45af-adda-734656bcca8e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-05-21T18:15:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-05-21T18:15:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-05-21T18:15:23Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-05-21T18:15:23Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/kuadrant/kuadrant-operator:v1.4.2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-kbg4w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.133.143\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.133.143\\\"}],\\\"startTime\\\":\\\"2026-05-21T18:15:23Z\\\"}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-55c7f4c975-h28jk\": pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" not found"
May 21 18:15:23.883319 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.883299    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"]
May 21 18:15:23.883521 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.883484    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" containerName="manager" containerID="cri-o://26b3414aa3f272baa7a62e20900c867a7485a03e979f3b915eba3e35e1454b3f" gracePeriod=2
May 21 18:15:23.886692 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.886645    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:23.898569 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.898474    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"]
May 21 18:15:23.900571 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.900538    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:15:23.900892 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.900876    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" containerName="manager"
May 21 18:15:23.900892 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.900892    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" containerName="manager"
May 21 18:15:23.901006 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.900934    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" containerName="manager"
May 21 18:15:23.905099 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.905084    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:23.911219 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.911190    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:23.913353 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.913325    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:23.921161 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.921138    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"]
May 21 18:15:23.921370 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.921347    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" podUID="337557b7-f11a-4300-ade0-4168369857f7" containerName="manager" containerID="cri-o://0303da5fc298b62d454b72d9639074e5d5f69ad09dfd1f088c41d6444be96631" gracePeriod=2
May 21 18:15:23.923058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.923037    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:23.928728 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.928709    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:23.931601 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.931583    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:23.934351 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.934331    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:15:23.937251 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.937229    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"]
May 21 18:15:23.952923 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.952904    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:23.969146 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.969120    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:23.971477 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.971457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:23.971547 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.971510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6jb\" (UniqueName: \"kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:23.971591 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.971565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:23.971678 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:23.971642    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f99k\" (UniqueName: \"kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.000140 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.000116    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.001896 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.001877    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.005256 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.005182    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qjsrl"
May 21 18:15:24.007338 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.007315    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.009253 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.009233    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.011095 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.011069    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.038079 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.038053    2557 generic.go:358] "Generic (PLEG): container finished" podID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" containerID="26b3414aa3f272baa7a62e20900c867a7485a03e979f3b915eba3e35e1454b3f" exitCode=0
May 21 18:15:24.043736 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.043679    2557 generic.go:358] "Generic (PLEG): container finished" podID="337557b7-f11a-4300-ade0-4168369857f7" containerID="0303da5fc298b62d454b72d9639074e5d5f69ad09dfd1f088c41d6444be96631" exitCode=0
May 21 18:15:24.043830 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.043764    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"
May 21 18:15:24.046077 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.046050    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.048039 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.048007    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.049640 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.049618    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"
May 21 18:15:24.049862 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.049832    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.051714 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.051691    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.053722 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.053701    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.055949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.055924    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.073183 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073122    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.073309 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073218    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6jb\" (UniqueName: \"kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:24.073309 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073252    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:24.073419 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073349    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f99k\" (UniqueName: \"kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.073672 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073633    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.073919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.073896    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:24.089540 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.089479    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f99k\" (UniqueName: \"kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k\") pod \"kuadrant-operator-controller-manager-55c7f4c975-v9hdk\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.089635 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.089539    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6jb\" (UniqueName: \"kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8hbnb\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:24.150252 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.150233    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:24.152528 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.152494    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.153274 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.153257    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:24.154466 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.154444    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.156211 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.156190    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.158152 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.158132    2557 status_manager.go:895] "Failed to get status for pod" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-zgwjc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.159978 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.159958    2557 status_manager.go:895] "Failed to get status for pod" podUID="337557b7-f11a-4300-ade0-4168369857f7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q" err="pods \"limitador-operator-controller-manager-85c4996f8c-f2f2q\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.161815 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.161799    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:24.174197 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.174179    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume\") pod \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") "
May 21 18:15:24.174262 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.174223    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t92tg\" (UniqueName: \"kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg\") pod \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\" (UID: \"e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e\") "
May 21 18:15:24.174299 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.174262    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8q44\" (UniqueName: \"kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44\") pod \"337557b7-f11a-4300-ade0-4168369857f7\" (UID: \"337557b7-f11a-4300-ade0-4168369857f7\") "
May 21 18:15:24.174508 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.174487    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" (UID: "e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:15:24.176292 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.176273    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg" (OuterVolumeSpecName: "kube-api-access-t92tg") pod "e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" (UID: "e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e"). InnerVolumeSpecName "kube-api-access-t92tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:15:24.176343 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.176294    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44" (OuterVolumeSpecName: "kube-api-access-b8q44") pod "337557b7-f11a-4300-ade0-4168369857f7" (UID: "337557b7-f11a-4300-ade0-4168369857f7"). InnerVolumeSpecName "kube-api-access-b8q44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:15:24.275682 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.275641    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-extensions-socket-volume\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:15:24.275682 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.275681    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t92tg\" (UniqueName: \"kubernetes.io/projected/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e-kube-api-access-t92tg\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:15:24.275798 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.275692    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8q44\" (UniqueName: \"kubernetes.io/projected/337557b7-f11a-4300-ade0-4168369857f7-kube-api-access-b8q44\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:15:24.309777 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.309725    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:24.315382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.315364    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:24.397366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.396459    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337557b7-f11a-4300-ade0-4168369857f7" path="/var/lib/kubelet/pods/337557b7-f11a-4300-ade0-4168369857f7/volumes"
May 21 18:15:24.397366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.396873    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" path="/var/lib/kubelet/pods/a0f70144-4d6a-45af-adda-734656bcca8e/volumes"
May 21 18:15:24.397366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.397112    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e" path="/var/lib/kubelet/pods/e4d9f6b9-2b4a-43e8-ad73-0fb3d03aae4e/volumes"
May 21 18:15:24.476785 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.476755    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:15:24.479284 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:24.479260    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45555ef6_dd31_4fe7_9b00_0c562d3848a7.slice/crio-da894236045381ee5c43a96bba6292fa66bc0162ad90e1d983e53c5f0954c8aa WatchSource:0}: Error finding container da894236045381ee5c43a96bba6292fa66bc0162ad90e1d983e53c5f0954c8aa: Status 404 returned error can't find the container with id da894236045381ee5c43a96bba6292fa66bc0162ad90e1d983e53c5f0954c8aa
May 21 18:15:24.493529 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:24.493507    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:24.495113 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:24.495089    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc170a5_fee1_4207_ae0c_0d699d0327ee.slice/crio-738ddf181ea25e0dbbdac82f9ba333034b8d16ea10447ca92bb8218b283d0f96 WatchSource:0}: Error finding container 738ddf181ea25e0dbbdac82f9ba333034b8d16ea10447ca92bb8218b283d0f96: Status 404 returned error can't find the container with id 738ddf181ea25e0dbbdac82f9ba333034b8d16ea10447ca92bb8218b283d0f96
May 21 18:15:25.048858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.048824    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" event={"ID":"45555ef6-dd31-4fe7-9b00-0c562d3848a7","Type":"ContainerStarted","Data":"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"}
May 21 18:15:25.048858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.048861    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" event={"ID":"45555ef6-dd31-4fe7-9b00-0c562d3848a7","Type":"ContainerStarted","Data":"da894236045381ee5c43a96bba6292fa66bc0162ad90e1d983e53c5f0954c8aa"}
May 21 18:15:25.049345 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.048899    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:25.050232 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.050200    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" event={"ID":"efc170a5-fee1-4207-ae0c-0d699d0327ee","Type":"ContainerStarted","Data":"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"}
May 21 18:15:25.050232 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.050231    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" event={"ID":"efc170a5-fee1-4207-ae0c-0d699d0327ee","Type":"ContainerStarted","Data":"738ddf181ea25e0dbbdac82f9ba333034b8d16ea10447ca92bb8218b283d0f96"}
May 21 18:15:25.050364 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.050326    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:25.051362 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.051335    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f2f2q"
May 21 18:15:25.051362 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.051352    2557 scope.go:117] "RemoveContainer" containerID="0303da5fc298b62d454b72d9639074e5d5f69ad09dfd1f088c41d6444be96631"
May 21 18:15:25.052584 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.052507    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk"
May 21 18:15:25.052646 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.052597    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgwjc"
May 21 18:15:25.059527 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.059511    2557 scope.go:117] "RemoveContainer" containerID="26b3414aa3f272baa7a62e20900c867a7485a03e979f3b915eba3e35e1454b3f"
May 21 18:15:25.078433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.078400    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" podStartSLOduration=2.078391896 podStartE2EDuration="2.078391896s" podCreationTimestamp="2026-05-21 18:15:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:25.07721587 +0000 UTC m=+607.328728325" watchObservedRunningTime="2026-05-21 18:15:25.078391896 +0000 UTC m=+607.329904338"
May 21 18:15:25.097633 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.097599    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" podStartSLOduration=2.097589626 podStartE2EDuration="2.097589626s" podCreationTimestamp="2026-05-21 18:15:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:25.096295328 +0000 UTC m=+607.347807770" watchObservedRunningTime="2026-05-21 18:15:25.097589626 +0000 UTC m=+607.349102068"
May 21 18:15:25.099751 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:25.099720    2557 status_manager.go:895] "Failed to get status for pod" podUID="a0f70144-4d6a-45af-adda-734656bcca8e" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-h28jk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-h28jk\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object"
May 21 18:15:36.060443 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.060414    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:36.060878 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.060474    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:15:36.149102 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.149071    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:36.149329 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.149292    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" podUID="efc170a5-fee1-4207-ae0c-0d699d0327ee" containerName="manager" containerID="cri-o://e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a" gracePeriod=10
May 21 18:15:36.391573 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.391544    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:36.462885 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.462854    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht6jb\" (UniqueName: \"kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb\") pod \"efc170a5-fee1-4207-ae0c-0d699d0327ee\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") "
May 21 18:15:36.463022 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.462903    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume\") pod \"efc170a5-fee1-4207-ae0c-0d699d0327ee\" (UID: \"efc170a5-fee1-4207-ae0c-0d699d0327ee\") "
May 21 18:15:36.463287 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.463264    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "efc170a5-fee1-4207-ae0c-0d699d0327ee" (UID: "efc170a5-fee1-4207-ae0c-0d699d0327ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:15:36.464687 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.464648    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb" (OuterVolumeSpecName: "kube-api-access-ht6jb") pod "efc170a5-fee1-4207-ae0c-0d699d0327ee" (UID: "efc170a5-fee1-4207-ae0c-0d699d0327ee"). InnerVolumeSpecName "kube-api-access-ht6jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:15:36.564182 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.564112    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht6jb\" (UniqueName: \"kubernetes.io/projected/efc170a5-fee1-4207-ae0c-0d699d0327ee-kube-api-access-ht6jb\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:15:36.564182 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:36.564148    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efc170a5-fee1-4207-ae0c-0d699d0327ee-extensions-socket-volume\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:15:37.101561 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.101528    2557 generic.go:358] "Generic (PLEG): container finished" podID="efc170a5-fee1-4207-ae0c-0d699d0327ee" containerID="e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a" exitCode=0
May 21 18:15:37.101985 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.101595    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"
May 21 18:15:37.101985 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.101605    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" event={"ID":"efc170a5-fee1-4207-ae0c-0d699d0327ee","Type":"ContainerDied","Data":"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"}
May 21 18:15:37.101985 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.101644    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb" event={"ID":"efc170a5-fee1-4207-ae0c-0d699d0327ee","Type":"ContainerDied","Data":"738ddf181ea25e0dbbdac82f9ba333034b8d16ea10447ca92bb8218b283d0f96"}
May 21 18:15:37.101985 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.101689    2557 scope.go:117] "RemoveContainer" containerID="e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"
May 21 18:15:37.110399 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.110380    2557 scope.go:117] "RemoveContainer" containerID="e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"
May 21 18:15:37.110629 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:15:37.110607    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a\": container with ID starting with e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a not found: ID does not exist" containerID="e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"
May 21 18:15:37.110715 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.110636    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a"} err="failed to get container status \"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a\": rpc error: code = NotFound desc = could not find container \"e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a\": container with ID starting with e810b9179922dbcc8ae3754e5245401de0471f30ab504af69015901dcee43a7a not found: ID does not exist"
May 21 18:15:37.123272 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.123221    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:37.129356 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:37.129333    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8hbnb"]
May 21 18:15:38.390355 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:38.390286    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc170a5-fee1-4207-ae0c-0d699d0327ee" path="/var/lib/kubelet/pods/efc170a5-fee1-4207-ae0c-0d699d0327ee/volumes"
May 21 18:15:52.493408 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493374    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"]
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493739    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337557b7-f11a-4300-ade0-4168369857f7" containerName="manager"
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493759    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="337557b7-f11a-4300-ade0-4168369857f7" containerName="manager"
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493779    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc170a5-fee1-4207-ae0c-0d699d0327ee" containerName="manager"
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493788    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc170a5-fee1-4207-ae0c-0d699d0327ee" containerName="manager"
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493860    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc170a5-fee1-4207-ae0c-0d699d0327ee" containerName="manager"
May 21 18:15:52.494040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.493874    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="337557b7-f11a-4300-ade0-4168369857f7" containerName="manager"
May 21 18:15:52.496827 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.496801    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.501117 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.501094    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g9lhf\""
May 21 18:15:52.512212 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.512191    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"]
May 21 18:15:52.573071 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573193 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4sv8\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-kube-api-access-h4sv8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573193 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573193 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578f29a3-7b95-4556-a03f-cf982d495a46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573325 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573325 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573325 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573302    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578f29a3-7b95-4556-a03f-cf982d495a46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573431 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.573431 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.573361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674625 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674596    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674760 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674638    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674760 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674674    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578f29a3-7b95-4556-a03f-cf982d495a46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674760 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674696    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674760 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674738    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674956 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674769    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674956 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674795    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4sv8\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-kube-api-access-h4sv8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674956 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674822    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.674956 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674862    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578f29a3-7b95-4556-a03f-cf982d495a46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.675147 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.674993    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.675147 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.675062    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.675305 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.675282    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.675367 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.675314    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.675367 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.675327    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/578f29a3-7b95-4556-a03f-cf982d495a46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.677062 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.677044    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/578f29a3-7b95-4556-a03f-cf982d495a46-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.677292 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.677275    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/578f29a3-7b95-4556-a03f-cf982d495a46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.686475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.686452    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.686605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.686587    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4sv8\" (UniqueName: \"kubernetes.io/projected/578f29a3-7b95-4556-a03f-cf982d495a46-kube-api-access-h4sv8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ljwls\" (UID: \"578f29a3-7b95-4556-a03f-cf982d495a46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.808492 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.808469    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:52.942195 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.942171    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"]
May 21 18:15:52.944212 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:52.944185    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f29a3_7b95_4556_a03f_cf982d495a46.slice/crio-b2cc3961ef0b84c00e8d9468a03120b9dc3bfdf3a7f2b7543b92db1dcf8d87d2 WatchSource:0}: Error finding container b2cc3961ef0b84c00e8d9468a03120b9dc3bfdf3a7f2b7543b92db1dcf8d87d2: Status 404 returned error can't find the container with id b2cc3961ef0b84c00e8d9468a03120b9dc3bfdf3a7f2b7543b92db1dcf8d87d2
May 21 18:15:52.946269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.946240    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:15:52.946332 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.946300    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:15:52.946332 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:52.946324    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:15:53.155236 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:53.155156    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls" event={"ID":"578f29a3-7b95-4556-a03f-cf982d495a46","Type":"ContainerStarted","Data":"2b70715fd83146ee0b86a76dc4fe33ffdddaea2eab3d9ad58159d52e647c780c"}
May 21 18:15:53.155236 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:53.155194    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls" event={"ID":"578f29a3-7b95-4556-a03f-cf982d495a46","Type":"ContainerStarted","Data":"b2cc3961ef0b84c00e8d9468a03120b9dc3bfdf3a7f2b7543b92db1dcf8d87d2"}
May 21 18:15:53.175984 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:53.175937    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls" podStartSLOduration=1.1759245759999999 podStartE2EDuration="1.175924576s" podCreationTimestamp="2026-05-21 18:15:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:53.173883957 +0000 UTC m=+635.425396399" watchObservedRunningTime="2026-05-21 18:15:53.175924576 +0000 UTC m=+635.427437017"
May 21 18:15:53.809482 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:53.809445    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:53.814269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:53.814243    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:54.158138 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:54.158063    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:54.159048 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:54.159024    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ljwls"
May 21 18:15:56.643280 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.643247    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:15:56.646373 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.646355    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.648773 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.648751    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 18:15:56.648841 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.648793    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fbcb8\""
May 21 18:15:56.653518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.653259    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:15:56.704320 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.704289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.704508 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.704393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sfwx\" (UniqueName: \"kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.738264 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.738234    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:15:56.804767 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.804737    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfwx\" (UniqueName: \"kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.804918 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.804786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.805314 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.805297    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.813152 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.813131    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sfwx\" (UniqueName: \"kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx\") pod \"limitador-limitador-7d549b5b-nzbsk\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:56.956529 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:56.956442    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:15:57.083047 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:57.083006    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:15:57.085603 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:15:57.085575    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2653e1c5_caca_41b5_ab55_54aa7513bcf4.slice/crio-2f6fefca9c68a7ae6c84f2c4e2ce944e9aafde9237eff5ee528c0e5de6e3909f WatchSource:0}: Error finding container 2f6fefca9c68a7ae6c84f2c4e2ce944e9aafde9237eff5ee528c0e5de6e3909f: Status 404 returned error can't find the container with id 2f6fefca9c68a7ae6c84f2c4e2ce944e9aafde9237eff5ee528c0e5de6e3909f
May 21 18:15:57.170627 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:15:57.170592    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" event={"ID":"2653e1c5-caca-41b5-ab55-54aa7513bcf4","Type":"ContainerStarted","Data":"2f6fefca9c68a7ae6c84f2c4e2ce944e9aafde9237eff5ee528c0e5de6e3909f"}
May 21 18:16:00.182843 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:00.182810    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" event={"ID":"2653e1c5-caca-41b5-ab55-54aa7513bcf4","Type":"ContainerStarted","Data":"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"}
May 21 18:16:00.183207 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:00.182932    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:16:00.202058 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:00.202009    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" podStartSLOduration=1.776129954 podStartE2EDuration="4.201995073s" podCreationTimestamp="2026-05-21 18:15:56 +0000 UTC" firstStartedPulling="2026-05-21 18:15:57.08759933 +0000 UTC m=+639.339111750" lastFinishedPulling="2026-05-21 18:15:59.513464445 +0000 UTC m=+641.764976869" observedRunningTime="2026-05-21 18:16:00.200610797 +0000 UTC m=+642.452123242" watchObservedRunningTime="2026-05-21 18:16:00.201995073 +0000 UTC m=+642.453507514"
May 21 18:16:11.186609 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:11.186578    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:16:11.846895 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:11.846864    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:16:11.847152 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:11.847127    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" podUID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" containerName="limitador" containerID="cri-o://1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d" gracePeriod=30
May 21 18:16:12.381057 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.381033    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:16:12.527573 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.527487    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file\") pod \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") "
May 21 18:16:12.527573 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.527538    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sfwx\" (UniqueName: \"kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx\") pod \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\" (UID: \"2653e1c5-caca-41b5-ab55-54aa7513bcf4\") "
May 21 18:16:12.528113 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.527933    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file" (OuterVolumeSpecName: "config-file") pod "2653e1c5-caca-41b5-ab55-54aa7513bcf4" (UID: "2653e1c5-caca-41b5-ab55-54aa7513bcf4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:16:12.530062 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.530035    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx" (OuterVolumeSpecName: "kube-api-access-5sfwx") pod "2653e1c5-caca-41b5-ab55-54aa7513bcf4" (UID: "2653e1c5-caca-41b5-ab55-54aa7513bcf4"). InnerVolumeSpecName "kube-api-access-5sfwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:16:12.628386 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.628358    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sfwx\" (UniqueName: \"kubernetes.io/projected/2653e1c5-caca-41b5-ab55-54aa7513bcf4-kube-api-access-5sfwx\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:16:12.628386 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:12.628383    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2653e1c5-caca-41b5-ab55-54aa7513bcf4-config-file\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:16:13.229519 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.229482    2557 generic.go:358] "Generic (PLEG): container finished" podID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" containerID="1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d" exitCode=0
May 21 18:16:13.229519 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.229523    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" event={"ID":"2653e1c5-caca-41b5-ab55-54aa7513bcf4","Type":"ContainerDied","Data":"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"}
May 21 18:16:13.229740 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.229544    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk" event={"ID":"2653e1c5-caca-41b5-ab55-54aa7513bcf4","Type":"ContainerDied","Data":"2f6fefca9c68a7ae6c84f2c4e2ce944e9aafde9237eff5ee528c0e5de6e3909f"}
May 21 18:16:13.229740 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.229548    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nzbsk"
May 21 18:16:13.229740 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.229558    2557 scope.go:117] "RemoveContainer" containerID="1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"
May 21 18:16:13.237818 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.237802    2557 scope.go:117] "RemoveContainer" containerID="1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"
May 21 18:16:13.238047 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:16:13.238029    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d\": container with ID starting with 1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d not found: ID does not exist" containerID="1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"
May 21 18:16:13.238112 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.238054    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d"} err="failed to get container status \"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d\": rpc error: code = NotFound desc = could not find container \"1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d\": container with ID starting with 1106c43dd3960df8174f8429952d04011363d37b8efcaf3aaacfdff9359e045d not found: ID does not exist"
May 21 18:16:13.251148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.251113    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:16:13.254144 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:13.254123    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nzbsk"]
May 21 18:16:14.391123 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:14.391089    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" path="/var/lib/kubelet/pods/2653e1c5-caca-41b5-ab55-54aa7513bcf4/volumes"
May 21 18:16:18.169993 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.169961    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mq468"]
May 21 18:16:18.170431 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.170380    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" containerName="limitador"
May 21 18:16:18.170431 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.170404    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" containerName="limitador"
May 21 18:16:18.170541 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.170491    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="2653e1c5-caca-41b5-ab55-54aa7513bcf4" containerName="limitador"
May 21 18:16:18.174899 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.174874    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.178038 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.178015    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 18:16:18.178172 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.178016    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hx8bx\""
May 21 18:16:18.184295 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.184274    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mq468"]
May 21 18:16:18.268963 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.268938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhgc\" (UniqueName: \"kubernetes.io/projected/9236f96a-cd16-47a2-a862-94e4da576ccb-kube-api-access-smhgc\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.269091 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.268992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9236f96a-cd16-47a2-a862-94e4da576ccb-data\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.369791 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.369767    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smhgc\" (UniqueName: \"kubernetes.io/projected/9236f96a-cd16-47a2-a862-94e4da576ccb-kube-api-access-smhgc\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.369885 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.369836    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9236f96a-cd16-47a2-a862-94e4da576ccb-data\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.370145 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.370127    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9236f96a-cd16-47a2-a862-94e4da576ccb-data\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.385958 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.385938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhgc\" (UniqueName: \"kubernetes.io/projected/9236f96a-cd16-47a2-a862-94e4da576ccb-kube-api-access-smhgc\") pod \"postgres-68c4fbbd6f-mq468\" (UID: \"9236f96a-cd16-47a2-a862-94e4da576ccb\") " pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.488776 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.488702    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hx8bx\""
May 21 18:16:18.496948 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.496930    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:18.620253 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:18.620225    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mq468"]
May 21 18:16:18.623231 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:16:18.623206    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9236f96a_cd16_47a2_a862_94e4da576ccb.slice/crio-e4d239fa202dea505c704529f87387b1dca733f28c5fe812858f4d2de3670511 WatchSource:0}: Error finding container e4d239fa202dea505c704529f87387b1dca733f28c5fe812858f4d2de3670511: Status 404 returned error can't find the container with id e4d239fa202dea505c704529f87387b1dca733f28c5fe812858f4d2de3670511
May 21 18:16:19.250421 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:19.250385    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mq468" event={"ID":"9236f96a-cd16-47a2-a862-94e4da576ccb","Type":"ContainerStarted","Data":"e4d239fa202dea505c704529f87387b1dca733f28c5fe812858f4d2de3670511"}
May 21 18:16:23.392203 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:23.392180    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 18:16:24.268706 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:24.268670    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mq468" event={"ID":"9236f96a-cd16-47a2-a862-94e4da576ccb","Type":"ContainerStarted","Data":"83bf9c57c2aa918b8d7425a962fc80bb633119694b386e9f3a1d547084e8cf1c"}
May 21 18:16:24.268990 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:24.268810    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:24.284485 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:24.284442    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-mq468" podStartSLOduration=1.5194422140000001 podStartE2EDuration="6.284432215s" podCreationTimestamp="2026-05-21 18:16:18 +0000 UTC" firstStartedPulling="2026-05-21 18:16:18.624622604 +0000 UTC m=+660.876135023" lastFinishedPulling="2026-05-21 18:16:23.389612596 +0000 UTC m=+665.641125024" observedRunningTime="2026-05-21 18:16:24.282863868 +0000 UTC m=+666.534376310" watchObservedRunningTime="2026-05-21 18:16:24.284432215 +0000 UTC m=+666.535944704"
May 21 18:16:30.300737 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:30.300707    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-mq468"
May 21 18:16:35.449503 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.449466    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7465f9c457-4ztrl"]
May 21 18:16:35.702127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.702051    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4ztrl"]
May 21 18:16:35.702127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.702079    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:35.702289 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.702187    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:35.705155 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.705128    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vlhtg\""
May 21 18:16:35.706152 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.706134    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 18:16:35.717471 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.717448    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:35.717578 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.717564    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:35.794870 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.794845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nm8w\" (UniqueName: \"kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w\") pod \"maas-controller-7465f9c457-4ztrl\" (UID: \"7c87cccc-c9a3-46c1-844c-dd99bbb69b4a\") " pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:35.794970 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.794887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8f8d\" (UniqueName: \"kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d\") pod \"maas-controller-7cdd4dfcf5-tzrtz\" (UID: \"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53\") " pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:35.798203 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.798183    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4ztrl"]
May 21 18:16:35.798337 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:16:35.798320    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9nm8w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-7465f9c457-4ztrl" podUID="7c87cccc-c9a3-46c1-844c-dd99bbb69b4a"
May 21 18:16:35.826187 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.826163    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:16:35.863854 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.863834    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:16:35.863948 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.863923    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:35.896038 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.896014    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8f8d\" (UniqueName: \"kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d\") pod \"maas-controller-7cdd4dfcf5-tzrtz\" (UID: \"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53\") " pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:35.896127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.896067    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nm8w\" (UniqueName: \"kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w\") pod \"maas-controller-7465f9c457-4ztrl\" (UID: \"7c87cccc-c9a3-46c1-844c-dd99bbb69b4a\") " pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:35.896127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.896106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglzs\" (UniqueName: \"kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs\") pod \"maas-controller-7c5f596894-47hlv\" (UID: \"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05\") " pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:35.904668 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.904632    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8f8d\" (UniqueName: \"kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d\") pod \"maas-controller-7cdd4dfcf5-tzrtz\" (UID: \"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53\") " pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:35.905415 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.905374    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nm8w\" (UniqueName: \"kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w\") pod \"maas-controller-7465f9c457-4ztrl\" (UID: \"7c87cccc-c9a3-46c1-844c-dd99bbb69b4a\") " pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:35.997331 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:35.997278    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fglzs\" (UniqueName: \"kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs\") pod \"maas-controller-7c5f596894-47hlv\" (UID: \"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05\") " pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:36.007975 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.007953    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglzs\" (UniqueName: \"kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs\") pod \"maas-controller-7c5f596894-47hlv\" (UID: \"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05\") " pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:36.028617 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.028586    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:36.148949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.148916    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:36.151624 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:16:36.151587    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc376a7e9_0bd7_4ebd_9968_cee1afaa3c53.slice/crio-8c15547c8f60564a1dde7ca8ccaad566820c323affe6afc5611e316f17b22955 WatchSource:0}: Error finding container 8c15547c8f60564a1dde7ca8ccaad566820c323affe6afc5611e316f17b22955: Status 404 returned error can't find the container with id 8c15547c8f60564a1dde7ca8ccaad566820c323affe6afc5611e316f17b22955
May 21 18:16:36.173270 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.173247    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:36.294862 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.294836    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:16:36.297815 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:16:36.297787    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73f5ee5_18ed_439d_b60f_a7bfc5fdbc05.slice/crio-b815d58d867657f773b2072f7c993674aa7682917d33e37c437bcd5fb77a4a15 WatchSource:0}: Error finding container b815d58d867657f773b2072f7c993674aa7682917d33e37c437bcd5fb77a4a15: Status 404 returned error can't find the container with id b815d58d867657f773b2072f7c993674aa7682917d33e37c437bcd5fb77a4a15
May 21 18:16:36.305398 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.305370    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" event={"ID":"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53","Type":"ContainerStarted","Data":"8c15547c8f60564a1dde7ca8ccaad566820c323affe6afc5611e316f17b22955"}
May 21 18:16:36.306349 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.306332    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:36.306426 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.306332    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5f596894-47hlv" event={"ID":"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05","Type":"ContainerStarted","Data":"b815d58d867657f773b2072f7c993674aa7682917d33e37c437bcd5fb77a4a15"}
May 21 18:16:36.310623 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.310608    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:36.399770 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.399751    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nm8w\" (UniqueName: \"kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w\") pod \"7c87cccc-c9a3-46c1-844c-dd99bbb69b4a\" (UID: \"7c87cccc-c9a3-46c1-844c-dd99bbb69b4a\") "
May 21 18:16:36.401562 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.401544    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w" (OuterVolumeSpecName: "kube-api-access-9nm8w") pod "7c87cccc-c9a3-46c1-844c-dd99bbb69b4a" (UID: "7c87cccc-c9a3-46c1-844c-dd99bbb69b4a"). InnerVolumeSpecName "kube-api-access-9nm8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:16:36.501056 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:36.501030    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nm8w\" (UniqueName: \"kubernetes.io/projected/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a-kube-api-access-9nm8w\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:16:37.312688 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:37.311818    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4ztrl"
May 21 18:16:37.388868 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:37.388838    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4ztrl"]
May 21 18:16:37.406225 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:37.406175    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4ztrl"]
May 21 18:16:38.394097 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:38.394057    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c87cccc-c9a3-46c1-844c-dd99bbb69b4a" path="/var/lib/kubelet/pods/7c87cccc-c9a3-46c1-844c-dd99bbb69b4a/volumes"
May 21 18:16:39.318853 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.318819    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" event={"ID":"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53","Type":"ContainerStarted","Data":"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"}
May 21 18:16:39.319120 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.319096    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:39.320366 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.320342    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5f596894-47hlv" event={"ID":"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05","Type":"ContainerStarted","Data":"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"}
May 21 18:16:39.320486 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.320422    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:39.348863 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.348822    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" podStartSLOduration=1.747712022 podStartE2EDuration="4.348810392s" podCreationTimestamp="2026-05-21 18:16:35 +0000 UTC" firstStartedPulling="2026-05-21 18:16:36.152928741 +0000 UTC m=+678.404441162" lastFinishedPulling="2026-05-21 18:16:38.754027095 +0000 UTC m=+681.005539532" observedRunningTime="2026-05-21 18:16:39.347220232 +0000 UTC m=+681.598732676" watchObservedRunningTime="2026-05-21 18:16:39.348810392 +0000 UTC m=+681.600322833"
May 21 18:16:39.371616 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:39.371571    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7c5f596894-47hlv" podStartSLOduration=1.912731569 podStartE2EDuration="4.371562599s" podCreationTimestamp="2026-05-21 18:16:35 +0000 UTC" firstStartedPulling="2026-05-21 18:16:36.29907653 +0000 UTC m=+678.550588949" lastFinishedPulling="2026-05-21 18:16:38.75790756 +0000 UTC m=+681.009419979" observedRunningTime="2026-05-21 18:16:39.369132625 +0000 UTC m=+681.620645078" watchObservedRunningTime="2026-05-21 18:16:39.371562599 +0000 UTC m=+681.623075068"
May 21 18:16:50.329172 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.329142    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:16:50.329539 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.329191    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:50.384279 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.384247    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:50.384466 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.384442    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" podUID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" containerName="manager" containerID="cri-o://8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281" gracePeriod=30
May 21 18:16:50.571286 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.571254    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:16:50.573719 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.573697    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:50.581477 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.581456    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:16:50.607528 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.607502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwvxw\" (UniqueName: \"kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw\") pod \"maas-controller-66b9dd549b-dkq7r\" (UID: \"97ac00da-0334-4249-a6a6-ffdbc3f3427e\") " pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:50.623488 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.623467    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:50.707859 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.707832    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8f8d\" (UniqueName: \"kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d\") pod \"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53\" (UID: \"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53\") "
May 21 18:16:50.708000 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.707955    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwvxw\" (UniqueName: \"kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw\") pod \"maas-controller-66b9dd549b-dkq7r\" (UID: \"97ac00da-0334-4249-a6a6-ffdbc3f3427e\") " pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:50.709933 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.709904    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d" (OuterVolumeSpecName: "kube-api-access-x8f8d") pod "c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" (UID: "c376a7e9-0bd7-4ebd-9968-cee1afaa3c53"). InnerVolumeSpecName "kube-api-access-x8f8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:16:50.716823 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.716800    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwvxw\" (UniqueName: \"kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw\") pod \"maas-controller-66b9dd549b-dkq7r\" (UID: \"97ac00da-0334-4249-a6a6-ffdbc3f3427e\") " pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:50.809093 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.809061    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8f8d\" (UniqueName: \"kubernetes.io/projected/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53-kube-api-access-x8f8d\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:16:50.885622 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:50.885565    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:51.004177 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.004152    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:16:51.006433 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:16:51.006403    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ac00da_0334_4249_a6a6_ffdbc3f3427e.slice/crio-ff6b6d56839a73ebdfd938a0ac7c0e14f6bef87efd12c90fbdaf96631bc81cc0 WatchSource:0}: Error finding container ff6b6d56839a73ebdfd938a0ac7c0e14f6bef87efd12c90fbdaf96631bc81cc0: Status 404 returned error can't find the container with id ff6b6d56839a73ebdfd938a0ac7c0e14f6bef87efd12c90fbdaf96631bc81cc0
May 21 18:16:51.359516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.359489    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" event={"ID":"97ac00da-0334-4249-a6a6-ffdbc3f3427e","Type":"ContainerStarted","Data":"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"}
May 21 18:16:51.359898 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.359527    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" event={"ID":"97ac00da-0334-4249-a6a6-ffdbc3f3427e","Type":"ContainerStarted","Data":"ff6b6d56839a73ebdfd938a0ac7c0e14f6bef87efd12c90fbdaf96631bc81cc0"}
May 21 18:16:51.359898 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.359585    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:16:51.360683 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.360639    2557 generic.go:358] "Generic (PLEG): container finished" podID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" containerID="8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281" exitCode=0
May 21 18:16:51.360756 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.360680    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" event={"ID":"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53","Type":"ContainerDied","Data":"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"}
May 21 18:16:51.360756 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.360711    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz" event={"ID":"c376a7e9-0bd7-4ebd-9968-cee1afaa3c53","Type":"ContainerDied","Data":"8c15547c8f60564a1dde7ca8ccaad566820c323affe6afc5611e316f17b22955"}
May 21 18:16:51.360756 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.360710    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd4dfcf5-tzrtz"
May 21 18:16:51.360864 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.360790    2557 scope.go:117] "RemoveContainer" containerID="8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"
May 21 18:16:51.367858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.367835    2557 scope.go:117] "RemoveContainer" containerID="8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"
May 21 18:16:51.368137 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:16:51.368113    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281\": container with ID starting with 8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281 not found: ID does not exist" containerID="8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"
May 21 18:16:51.368211 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.368150    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281"} err="failed to get container status \"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281\": rpc error: code = NotFound desc = could not find container \"8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281\": container with ID starting with 8252477f65bc957afa69558d1f33a5c764595f1174750014e86a21358ff0c281 not found: ID does not exist"
May 21 18:16:51.382095 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.382057    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" podStartSLOduration=1.090532278 podStartE2EDuration="1.38204691s" podCreationTimestamp="2026-05-21 18:16:50 +0000 UTC" firstStartedPulling="2026-05-21 18:16:51.007764382 +0000 UTC m=+693.259276805" lastFinishedPulling="2026-05-21 18:16:51.29927901 +0000 UTC m=+693.550791437" observedRunningTime="2026-05-21 18:16:51.381084017 +0000 UTC m=+693.632596459" watchObservedRunningTime="2026-05-21 18:16:51.38204691 +0000 UTC m=+693.633559351"
May 21 18:16:51.394612 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.394591    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:51.402010 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:51.401990    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdd4dfcf5-tzrtz"]
May 21 18:16:52.390502 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:16:52.390469    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" path="/var/lib/kubelet/pods/c376a7e9-0bd7-4ebd-9968-cee1afaa3c53/volumes"
May 21 18:17:02.374123 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.374091    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:17:02.468050 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.468018    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:17:02.468305 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.468261    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7c5f596894-47hlv" podUID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" containerName="manager" containerID="cri-o://d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362" gracePeriod=30
May 21 18:17:02.708480 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.708458    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:17:02.795509 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.795485    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fglzs\" (UniqueName: \"kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs\") pod \"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05\" (UID: \"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05\") "
May 21 18:17:02.797422 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.797398    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs" (OuterVolumeSpecName: "kube-api-access-fglzs") pod "e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" (UID: "e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05"). InnerVolumeSpecName "kube-api-access-fglzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:17:02.896556 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:02.896481    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fglzs\" (UniqueName: \"kubernetes.io/projected/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05-kube-api-access-fglzs\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:17:03.399797 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.399767    2557 generic.go:358] "Generic (PLEG): container finished" podID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" containerID="d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362" exitCode=0
May 21 18:17:03.400190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.399820    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5f596894-47hlv" event={"ID":"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05","Type":"ContainerDied","Data":"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"}
May 21 18:17:03.400190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.399827    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c5f596894-47hlv"
May 21 18:17:03.400190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.399843    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c5f596894-47hlv" event={"ID":"e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05","Type":"ContainerDied","Data":"b815d58d867657f773b2072f7c993674aa7682917d33e37c437bcd5fb77a4a15"}
May 21 18:17:03.400190 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.399858    2557 scope.go:117] "RemoveContainer" containerID="d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"
May 21 18:17:03.408160 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.408135    2557 scope.go:117] "RemoveContainer" containerID="d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"
May 21 18:17:03.408428 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:17:03.408411    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362\": container with ID starting with d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362 not found: ID does not exist" containerID="d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"
May 21 18:17:03.408482 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.408436    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362"} err="failed to get container status \"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362\": rpc error: code = NotFound desc = could not find container \"d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362\": container with ID starting with d99e419c49f7cb39657bbd1f704194d789f5b99fce92903188eb428caf1d7362 not found: ID does not exist"
May 21 18:17:03.421219 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.421201    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:17:03.424905 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:03.424885    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c5f596894-47hlv"]
May 21 18:17:04.392189 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:04.392158    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" path="/var/lib/kubelet/pods/e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05/volumes"
May 21 18:17:09.405507 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405433    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-78c69f4c5-9z9pp"]
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405713    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" containerName="manager"
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405724    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" containerName="manager"
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405745    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" containerName="manager"
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405750    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" containerName="manager"
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405797    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e73f5ee5-18ed-439d-b60f-a7bfc5fdbc05" containerName="manager"
May 21 18:17:09.405835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.405805    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c376a7e9-0bd7-4ebd-9968-cee1afaa3c53" containerName="manager"
May 21 18:17:09.408029 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.408011    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:09.410550 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.410532    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 18:17:09.422708 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.422685    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-78c69f4c5-9z9pp"]
May 21 18:17:09.550609 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.550582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fc4j\" (UniqueName: \"kubernetes.io/projected/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-kube-api-access-2fc4j\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:09.550767 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.550644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:09.651476 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.651443    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fc4j\" (UniqueName: \"kubernetes.io/projected/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-kube-api-access-2fc4j\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:09.651648 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.651531    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:09.651742 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:17:09.651682    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 21 18:17:09.651803 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:17:09.651764    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls podName:8cb7f9a0-e59a-46f8-93e5-fc95789b1075 nodeName:}" failed. No retries permitted until 2026-05-21 18:17:10.151740167 +0000 UTC m=+712.403252594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls") pod "maas-api-78c69f4c5-9z9pp" (UID: "8cb7f9a0-e59a-46f8-93e5-fc95789b1075") : secret "maas-api-serving-cert" not found
May 21 18:17:09.663162 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:09.663096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fc4j\" (UniqueName: \"kubernetes.io/projected/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-kube-api-access-2fc4j\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:10.157409 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:10.157357    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:10.160327 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:10.160293    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cb7f9a0-e59a-46f8-93e5-fc95789b1075-maas-api-tls\") pod \"maas-api-78c69f4c5-9z9pp\" (UID: \"8cb7f9a0-e59a-46f8-93e5-fc95789b1075\") " pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:10.317840 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:10.317808    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:10.454305 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:10.454216    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-78c69f4c5-9z9pp"]
May 21 18:17:11.442062 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:11.442018    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-78c69f4c5-9z9pp" event={"ID":"8cb7f9a0-e59a-46f8-93e5-fc95789b1075","Type":"ContainerStarted","Data":"1523a872bd4d4e6e3e9e31cca161d1716872c6dc89678c81d70031c2460d7dba"}
May 21 18:17:12.446771 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:12.446690    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-78c69f4c5-9z9pp" event={"ID":"8cb7f9a0-e59a-46f8-93e5-fc95789b1075","Type":"ContainerStarted","Data":"cfa97b28b9b215ed5b769d718744f432c8e8f6b82b3df415703987689b6ae101"}
May 21 18:17:12.447705 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:12.447680    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:17:12.467372 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:12.467326    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-78c69f4c5-9z9pp" podStartSLOduration=1.736305064 podStartE2EDuration="3.467314614s" podCreationTimestamp="2026-05-21 18:17:09 +0000 UTC" firstStartedPulling="2026-05-21 18:17:10.463480501 +0000 UTC m=+712.714992924" lastFinishedPulling="2026-05-21 18:17:12.194490049 +0000 UTC m=+714.446002474" observedRunningTime="2026-05-21 18:17:12.466248891 +0000 UTC m=+714.717761332" watchObservedRunningTime="2026-05-21 18:17:12.467314614 +0000 UTC m=+714.718827056"
May 21 18:17:19.457447 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:17:19.457413    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-78c69f4c5-9z9pp"
May 21 18:18:10.417975 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.417941    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"]
May 21 18:18:10.419934 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.419917    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.422768 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.422748    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 18:18:10.423766 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.423746    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 18:18:10.423858 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.423781    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ppkz\""
May 21 18:18:10.425353 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.425323    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 18:18:10.437481 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.437461    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"]
May 21 18:18:10.506891 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.506860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.507028 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.506894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.507028 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.506914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.507107 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.507079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.507146 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.507130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkcmv\" (UniqueName: \"kubernetes.io/projected/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kube-api-access-tkcmv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.507189 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.507153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608457 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608424    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608467    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkcmv\" (UniqueName: \"kubernetes.io/projected/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kube-api-access-tkcmv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608492    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608517    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608539    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608605 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608557    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608894 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.608949 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608903    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.609014 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.608996    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.610823 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.610806    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.610987 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.610970    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.617141 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.617105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkcmv\" (UniqueName: \"kubernetes.io/projected/28abe6ec-e8bd-4201-b7a7-f67ced2f0533-kube-api-access-tkcmv\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb\" (UID: \"28abe6ec-e8bd-4201-b7a7-f67ced2f0533\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.729337 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.729266    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:10.855565 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.855381    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"]
May 21 18:18:10.857935 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:18:10.857905    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28abe6ec_e8bd_4201_b7a7_f67ced2f0533.slice/crio-ff2b27d1a23482b45d32101ee47df83f3947ab603c6a0f68a21ea8e375774f4f WatchSource:0}: Error finding container ff2b27d1a23482b45d32101ee47df83f3947ab603c6a0f68a21ea8e375774f4f: Status 404 returned error can't find the container with id ff2b27d1a23482b45d32101ee47df83f3947ab603c6a0f68a21ea8e375774f4f
May 21 18:18:10.859945 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:10.859928    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:18:11.632840 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:11.632795    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb" event={"ID":"28abe6ec-e8bd-4201-b7a7-f67ced2f0533","Type":"ContainerStarted","Data":"ff2b27d1a23482b45d32101ee47df83f3947ab603c6a0f68a21ea8e375774f4f"}
May 21 18:18:16.652486 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:16.652447    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb" event={"ID":"28abe6ec-e8bd-4201-b7a7-f67ced2f0533","Type":"ContainerStarted","Data":"b4ea17db5a7c49cc02ceac72083505c8792b4d307d75dcd5080a17619ae2ac6e"}
May 21 18:18:24.681147 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:24.681115    2557 generic.go:358] "Generic (PLEG): container finished" podID="28abe6ec-e8bd-4201-b7a7-f67ced2f0533" containerID="b4ea17db5a7c49cc02ceac72083505c8792b4d307d75dcd5080a17619ae2ac6e" exitCode=0
May 21 18:18:24.681484 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:24.681194    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb" event={"ID":"28abe6ec-e8bd-4201-b7a7-f67ced2f0533","Type":"ContainerDied","Data":"b4ea17db5a7c49cc02ceac72083505c8792b4d307d75dcd5080a17619ae2ac6e"}
May 21 18:18:26.688845 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:26.688810    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb" event={"ID":"28abe6ec-e8bd-4201-b7a7-f67ced2f0533","Type":"ContainerStarted","Data":"dcd68d15aeb567fda384105ec44c9d526586e7c2e8b9ebc190416ae5517afea9"}
May 21 18:18:26.689205 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:26.688999    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:26.711598 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:26.711553    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb" podStartSLOduration=1.66242614 podStartE2EDuration="16.71154152s" podCreationTimestamp="2026-05-21 18:18:10 +0000 UTC" firstStartedPulling="2026-05-21 18:18:10.860052528 +0000 UTC m=+773.111564953" lastFinishedPulling="2026-05-21 18:18:25.90916791 +0000 UTC m=+788.160680333" observedRunningTime="2026-05-21 18:18:26.709363694 +0000 UTC m=+788.960876146" watchObservedRunningTime="2026-05-21 18:18:26.71154152 +0000 UTC m=+788.963053962"
May 21 18:18:33.874110 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:33.874075    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"]
May 21 18:18:34.025110 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.025076    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"]
May 21 18:18:34.025256 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.025217    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.027793 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.027772    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 18:18:34.110901 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.110874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq5rr\" (UniqueName: \"kubernetes.io/projected/3478d5f3-4390-4014-bf5a-19011b9a9893-kube-api-access-kq5rr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.111006 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.110913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.111006 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.110934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.111129 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.110997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3478d5f3-4390-4014-bf5a-19011b9a9893-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.111129 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.111072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.111129 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.111103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211694 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211631    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211694 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211678    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211863 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3478d5f3-4390-4014-bf5a-19011b9a9893-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211863 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211732    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211863 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211753    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.211863 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.211786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kq5rr\" (UniqueName: \"kubernetes.io/projected/3478d5f3-4390-4014-bf5a-19011b9a9893-kube-api-access-kq5rr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.212074 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.212053    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.212126 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.212094    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.212184 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.212153    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.214147 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.214111    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3478d5f3-4390-4014-bf5a-19011b9a9893-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.214283 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.214264    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3478d5f3-4390-4014-bf5a-19011b9a9893-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.220444 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.220421    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq5rr\" (UniqueName: \"kubernetes.io/projected/3478d5f3-4390-4014-bf5a-19011b9a9893-kube-api-access-kq5rr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk\" (UID: \"3478d5f3-4390-4014-bf5a-19011b9a9893\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.334905 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.334874    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:34.469508 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.469479    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"]
May 21 18:18:34.471918 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:18:34.471890    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3478d5f3_4390_4014_bf5a_19011b9a9893.slice/crio-5edb88e85b1878c40f1acda67e91732d2f1194e5d153a978489c70c079178d20 WatchSource:0}: Error finding container 5edb88e85b1878c40f1acda67e91732d2f1194e5d153a978489c70c079178d20: Status 404 returned error can't find the container with id 5edb88e85b1878c40f1acda67e91732d2f1194e5d153a978489c70c079178d20
May 21 18:18:34.714362 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.714318    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk" event={"ID":"3478d5f3-4390-4014-bf5a-19011b9a9893","Type":"ContainerStarted","Data":"442c41e7ca43a8c64a89ec946c4027a048c20aaa855e11784541c7cef3a461c8"}
May 21 18:18:34.714362 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:34.714362    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk" event={"ID":"3478d5f3-4390-4014-bf5a-19011b9a9893","Type":"ContainerStarted","Data":"5edb88e85b1878c40f1acda67e91732d2f1194e5d153a978489c70c079178d20"}
May 21 18:18:37.706637 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:37.706555    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb"
May 21 18:18:40.744483 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:40.744432    2557 generic.go:358] "Generic (PLEG): container finished" podID="3478d5f3-4390-4014-bf5a-19011b9a9893" containerID="442c41e7ca43a8c64a89ec946c4027a048c20aaa855e11784541c7cef3a461c8" exitCode=0
May 21 18:18:40.744832 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:40.744510    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk" event={"ID":"3478d5f3-4390-4014-bf5a-19011b9a9893","Type":"ContainerDied","Data":"442c41e7ca43a8c64a89ec946c4027a048c20aaa855e11784541c7cef3a461c8"}
May 21 18:18:41.749133 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:41.749058    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk" event={"ID":"3478d5f3-4390-4014-bf5a-19011b9a9893","Type":"ContainerStarted","Data":"9f77ccd7dc3b3b0f0c93949a1fd606f176909765790bf33e0b79315604a9af8e"}
May 21 18:18:41.749478 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:41.749270    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:18:41.787461 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:41.787418    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk" podStartSLOduration=8.217233342 podStartE2EDuration="8.787407461s" podCreationTimestamp="2026-05-21 18:18:33 +0000 UTC" firstStartedPulling="2026-05-21 18:18:40.745131263 +0000 UTC m=+802.996643683" lastFinishedPulling="2026-05-21 18:18:41.31530537 +0000 UTC m=+803.566817802" observedRunningTime="2026-05-21 18:18:41.787389981 +0000 UTC m=+804.038902422" watchObservedRunningTime="2026-05-21 18:18:41.787407461 +0000 UTC m=+804.038919902"
May 21 18:18:41.984603 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:41.984566    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"]
May 21 18:18:42.006639 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.006561    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"]
May 21 18:18:42.006792 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.006688    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.009516 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.009497    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 18:18:42.084250 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zb6\" (UniqueName: \"kubernetes.io/projected/76d92991-c985-4836-8cc2-16a03cc61ca9-kube-api-access-g6zb6\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.084433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.084433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d92991-c985-4836-8cc2-16a03cc61ca9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.084433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.084433 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084404    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.084616 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.084477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185588 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185560    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zb6\" (UniqueName: \"kubernetes.io/projected/76d92991-c985-4836-8cc2-16a03cc61ca9-kube-api-access-g6zb6\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185780 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185611    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185780 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d92991-c985-4836-8cc2-16a03cc61ca9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185780 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185713    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185780 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185750    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.185955 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.185782    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.186064 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.186040    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.186194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.186167    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.186194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.186185    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.187982 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.187959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76d92991-c985-4836-8cc2-16a03cc61ca9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.188153 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.188137    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76d92991-c985-4836-8cc2-16a03cc61ca9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.193362 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.193337    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zb6\" (UniqueName: \"kubernetes.io/projected/76d92991-c985-4836-8cc2-16a03cc61ca9-kube-api-access-g6zb6\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8\" (UID: \"76d92991-c985-4836-8cc2-16a03cc61ca9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.320069 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.320029    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:42.448775 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.448743    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"]
May 21 18:18:42.452333 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:18:42.452301    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d92991_c985_4836_8cc2_16a03cc61ca9.slice/crio-6ee9776a63b054e74320ba03e50dbf4e20634fb93409e70f2833c0ad7365e0c7 WatchSource:0}: Error finding container 6ee9776a63b054e74320ba03e50dbf4e20634fb93409e70f2833c0ad7365e0c7: Status 404 returned error can't find the container with id 6ee9776a63b054e74320ba03e50dbf4e20634fb93409e70f2833c0ad7365e0c7
May 21 18:18:42.753350 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.753251    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8" event={"ID":"76d92991-c985-4836-8cc2-16a03cc61ca9","Type":"ContainerStarted","Data":"551fd158d8ba84979a6a430bd9ca039fe76a9f5536f20d53956a906f64c30fcf"}
May 21 18:18:42.753350 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:42.753302    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8" event={"ID":"76d92991-c985-4836-8cc2-16a03cc61ca9","Type":"ContainerStarted","Data":"6ee9776a63b054e74320ba03e50dbf4e20634fb93409e70f2833c0ad7365e0c7"}
May 21 18:18:48.774357 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:48.774323    2557 generic.go:358] "Generic (PLEG): container finished" podID="76d92991-c985-4836-8cc2-16a03cc61ca9" containerID="551fd158d8ba84979a6a430bd9ca039fe76a9f5536f20d53956a906f64c30fcf" exitCode=0
May 21 18:18:48.774750 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:48.774370    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8" event={"ID":"76d92991-c985-4836-8cc2-16a03cc61ca9","Type":"ContainerDied","Data":"551fd158d8ba84979a6a430bd9ca039fe76a9f5536f20d53956a906f64c30fcf"}
May 21 18:18:49.778430 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:49.778397    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8" event={"ID":"76d92991-c985-4836-8cc2-16a03cc61ca9","Type":"ContainerStarted","Data":"a9c57fb176549fdfebe125ef3554532450dbd9df0d42edbe0a095c2208f1506e"}
May 21 18:18:49.778835 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:49.778609    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:18:49.797367 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:49.797320    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8" podStartSLOduration=8.456580754 podStartE2EDuration="8.797306548s" podCreationTimestamp="2026-05-21 18:18:41 +0000 UTC" firstStartedPulling="2026-05-21 18:18:48.774970409 +0000 UTC m=+811.026482829" lastFinishedPulling="2026-05-21 18:18:49.115696186 +0000 UTC m=+811.367208623" observedRunningTime="2026-05-21 18:18:49.795883593 +0000 UTC m=+812.047396037" watchObservedRunningTime="2026-05-21 18:18:49.797306548 +0000 UTC m=+812.048818989"
May 21 18:18:52.766070 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:18:52.766039    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk"
May 21 18:19:00.794720 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:19:00.794688    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8"
May 21 18:20:28.254494 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.254453    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:20:28.255074 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.254773    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" podUID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" containerName="manager" containerID="cri-o://18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d" gracePeriod=30
May 21 18:20:28.502942 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.502914    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:20:28.652360 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.652332    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwvxw\" (UniqueName: \"kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw\") pod \"97ac00da-0334-4249-a6a6-ffdbc3f3427e\" (UID: \"97ac00da-0334-4249-a6a6-ffdbc3f3427e\") "
May 21 18:20:28.654276 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.654254    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw" (OuterVolumeSpecName: "kube-api-access-qwvxw") pod "97ac00da-0334-4249-a6a6-ffdbc3f3427e" (UID: "97ac00da-0334-4249-a6a6-ffdbc3f3427e"). InnerVolumeSpecName "kube-api-access-qwvxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:20:28.753513 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:28.753477    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwvxw\" (UniqueName: \"kubernetes.io/projected/97ac00da-0334-4249-a6a6-ffdbc3f3427e-kube-api-access-qwvxw\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:20:29.105202 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.105170    2557 generic.go:358] "Generic (PLEG): container finished" podID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" containerID="18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d" exitCode=0
May 21 18:20:29.105382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.105227    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-dkq7r"
May 21 18:20:29.105382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.105236    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" event={"ID":"97ac00da-0334-4249-a6a6-ffdbc3f3427e","Type":"ContainerDied","Data":"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"}
May 21 18:20:29.105382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.105268    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-dkq7r" event={"ID":"97ac00da-0334-4249-a6a6-ffdbc3f3427e","Type":"ContainerDied","Data":"ff6b6d56839a73ebdfd938a0ac7c0e14f6bef87efd12c90fbdaf96631bc81cc0"}
May 21 18:20:29.105382 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.105287    2557 scope.go:117] "RemoveContainer" containerID="18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"
May 21 18:20:29.113475 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.113457    2557 scope.go:117] "RemoveContainer" containerID="18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"
May 21 18:20:29.113720 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:20:29.113703    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d\": container with ID starting with 18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d not found: ID does not exist" containerID="18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"
May 21 18:20:29.113771 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.113728    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d"} err="failed to get container status \"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d\": rpc error: code = NotFound desc = could not find container \"18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d\": container with ID starting with 18bd95e75594519a4e4fedb0a6904d486d1697138612adff90e3dee342ab0e9d not found: ID does not exist"
May 21 18:20:29.125959 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.125939    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:20:29.129924 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.129902    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-dkq7r"]
May 21 18:20:29.878887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.878856    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66b9dd549b-zbngn"]
May 21 18:20:29.879246 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.879151    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" containerName="manager"
May 21 18:20:29.879246 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.879161    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" containerName="manager"
May 21 18:20:29.879246 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.879213    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" containerName="manager"
May 21 18:20:29.881437 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.881421    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:29.883976 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.883957    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vlhtg\""
May 21 18:20:29.889617 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:29.889596    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-zbngn"]
May 21 18:20:30.064035 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.064005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnrs\" (UniqueName: \"kubernetes.io/projected/f276e1b0-7931-4df8-b2be-5600b7dd61dd-kube-api-access-wqnrs\") pod \"maas-controller-66b9dd549b-zbngn\" (UID: \"f276e1b0-7931-4df8-b2be-5600b7dd61dd\") " pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:30.165072 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.164989    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrs\" (UniqueName: \"kubernetes.io/projected/f276e1b0-7931-4df8-b2be-5600b7dd61dd-kube-api-access-wqnrs\") pod \"maas-controller-66b9dd549b-zbngn\" (UID: \"f276e1b0-7931-4df8-b2be-5600b7dd61dd\") " pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:30.173523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.173501    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnrs\" (UniqueName: \"kubernetes.io/projected/f276e1b0-7931-4df8-b2be-5600b7dd61dd-kube-api-access-wqnrs\") pod \"maas-controller-66b9dd549b-zbngn\" (UID: \"f276e1b0-7931-4df8-b2be-5600b7dd61dd\") " pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:30.192095 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.192074    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:30.319318 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.319289    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66b9dd549b-zbngn"]
May 21 18:20:30.321801 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:20:30.321758    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf276e1b0_7931_4df8_b2be_5600b7dd61dd.slice/crio-ab880cb35eb05e095670bf63f0f157f538b9ea581b014d19a7d5d3e31fa0cd3e WatchSource:0}: Error finding container ab880cb35eb05e095670bf63f0f157f538b9ea581b014d19a7d5d3e31fa0cd3e: Status 404 returned error can't find the container with id ab880cb35eb05e095670bf63f0f157f538b9ea581b014d19a7d5d3e31fa0cd3e
May 21 18:20:30.390956 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:30.390928    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ac00da-0334-4249-a6a6-ffdbc3f3427e" path="/var/lib/kubelet/pods/97ac00da-0334-4249-a6a6-ffdbc3f3427e/volumes"
May 21 18:20:31.114345 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:31.114308    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-zbngn" event={"ID":"f276e1b0-7931-4df8-b2be-5600b7dd61dd","Type":"ContainerStarted","Data":"b867d86aba089740ce411c5c1f4ba9b01eb88571094feaaa3e74de67e21b1941"}
May 21 18:20:31.114735 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:31.114352    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66b9dd549b-zbngn" event={"ID":"f276e1b0-7931-4df8-b2be-5600b7dd61dd","Type":"ContainerStarted","Data":"ab880cb35eb05e095670bf63f0f157f538b9ea581b014d19a7d5d3e31fa0cd3e"}
May 21 18:20:31.114735 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:31.114384    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:20:31.132203 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:31.132160    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-66b9dd549b-zbngn" podStartSLOduration=1.6964669510000001 podStartE2EDuration="2.132145534s" podCreationTimestamp="2026-05-21 18:20:29 +0000 UTC" firstStartedPulling="2026-05-21 18:20:30.323588773 +0000 UTC m=+912.575101194" lastFinishedPulling="2026-05-21 18:20:30.759267352 +0000 UTC m=+913.010779777" observedRunningTime="2026-05-21 18:20:31.131434278 +0000 UTC m=+913.382946722" watchObservedRunningTime="2026-05-21 18:20:31.132145534 +0000 UTC m=+913.383657976"
May 21 18:20:42.123575 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:20:42.123542    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66b9dd549b-zbngn"
May 21 18:30:46.416671 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:46.416557    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:30:46.419221 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:46.416936    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" podUID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" containerName="manager" containerID="cri-o://e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65" gracePeriod=10
May 21 18:30:47.465737 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.465713    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:30:47.570451 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.570377    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f99k\" (UniqueName: \"kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k\") pod \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") "
May 21 18:30:47.570451 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.570426    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume\") pod \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\" (UID: \"45555ef6-dd31-4fe7-9b00-0c562d3848a7\") "
May 21 18:30:47.570864 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.570842    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "45555ef6-dd31-4fe7-9b00-0c562d3848a7" (UID: "45555ef6-dd31-4fe7-9b00-0c562d3848a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:30:47.572269 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.572245    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k" (OuterVolumeSpecName: "kube-api-access-5f99k") pod "45555ef6-dd31-4fe7-9b00-0c562d3848a7" (UID: "45555ef6-dd31-4fe7-9b00-0c562d3848a7"). InnerVolumeSpecName "kube-api-access-5f99k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:30:47.672040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.672003    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f99k\" (UniqueName: \"kubernetes.io/projected/45555ef6-dd31-4fe7-9b00-0c562d3848a7-kube-api-access-5f99k\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:30:47.672040 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:47.672035    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45555ef6-dd31-4fe7-9b00-0c562d3848a7-extensions-socket-volume\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\""
May 21 18:30:48.109751 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.109719    2557 generic.go:358] "Generic (PLEG): container finished" podID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" containerID="e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65" exitCode=0
May 21 18:30:48.109914 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.109758    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" event={"ID":"45555ef6-dd31-4fe7-9b00-0c562d3848a7","Type":"ContainerDied","Data":"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"}
May 21 18:30:48.109914 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.109779    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk" event={"ID":"45555ef6-dd31-4fe7-9b00-0c562d3848a7","Type":"ContainerDied","Data":"da894236045381ee5c43a96bba6292fa66bc0162ad90e1d983e53c5f0954c8aa"}
May 21 18:30:48.109914 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.109779    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"
May 21 18:30:48.109914 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.109801    2557 scope.go:117] "RemoveContainer" containerID="e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"
May 21 18:30:48.118505 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.118484    2557 scope.go:117] "RemoveContainer" containerID="e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"
May 21 18:30:48.118743 ip-10-0-133-143 kubenswrapper[2557]: E0521 18:30:48.118724    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65\": container with ID starting with e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65 not found: ID does not exist" containerID="e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"
May 21 18:30:48.118808 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.118751    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65"} err="failed to get container status \"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65\": rpc error: code = NotFound desc = could not find container \"e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65\": container with ID starting with e3926d331ebe8f04acd4dc16e71cc73676e79fa5328366d7217a746e43af5a65 not found: ID does not exist"
May 21 18:30:48.138276 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.138250    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:30:48.146075 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.146051    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-v9hdk"]
May 21 18:30:48.391898 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:30:48.391820    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" path="/var/lib/kubelet/pods/45555ef6-dd31-4fe7-9b00-0c562d3848a7/volumes"
May 21 18:31:52.564019 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.563976    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"]
May 21 18:31:52.564707 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.564431    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" containerName="manager"
May 21 18:31:52.564707 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.564450    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" containerName="manager"
May 21 18:31:52.564707 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.564554    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="45555ef6-dd31-4fe7-9b00-0c562d3848a7" containerName="manager"
May 21 18:31:52.567291 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.567270    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.570192 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.570174    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6hpxh\""
May 21 18:31:52.598899 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.598867    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"]
May 21 18:31:52.621266 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.621233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5675f6d6-4192-4306-a670-09a0e327ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.621404 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.621277    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzktq\" (UniqueName: \"kubernetes.io/projected/5675f6d6-4192-4306-a670-09a0e327ff67-kube-api-access-gzktq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.722316 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.722279    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5675f6d6-4192-4306-a670-09a0e327ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.722503 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.722324    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzktq\" (UniqueName: \"kubernetes.io/projected/5675f6d6-4192-4306-a670-09a0e327ff67-kube-api-access-gzktq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.722677 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.722640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5675f6d6-4192-4306-a670-09a0e327ff67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.732095 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.732068    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzktq\" (UniqueName: \"kubernetes.io/projected/5675f6d6-4192-4306-a670-09a0e327ff67-kube-api-access-gzktq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m88tb\" (UID: \"5675f6d6-4192-4306-a670-09a0e327ff67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:52.877398 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:52.877308    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:53.013868 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.013837    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"]
May 21 18:31:53.019457 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:31:53.019421    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5675f6d6_4192_4306_a670_09a0e327ff67.slice/crio-8a6213e3765ade2c47645c7a3cc00777c3f886b0e0d00ee7565471922cf037e3 WatchSource:0}: Error finding container 8a6213e3765ade2c47645c7a3cc00777c3f886b0e0d00ee7565471922cf037e3: Status 404 returned error can't find the container with id 8a6213e3765ade2c47645c7a3cc00777c3f886b0e0d00ee7565471922cf037e3
May 21 18:31:53.022151 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.022133    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:31:53.323545 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.323508    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb" event={"ID":"5675f6d6-4192-4306-a670-09a0e327ff67","Type":"ContainerStarted","Data":"f44e28edbb22c2de98f6a886e063faab636f216441c5f25cc1bc4df4a97248d9"}
May 21 18:31:53.323545 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.323547    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb" event={"ID":"5675f6d6-4192-4306-a670-09a0e327ff67","Type":"ContainerStarted","Data":"8a6213e3765ade2c47645c7a3cc00777c3f886b0e0d00ee7565471922cf037e3"}
May 21 18:31:53.323805 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.323571    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:31:53.352501 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:31:53.352449    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb" podStartSLOduration=1.35242894 podStartE2EDuration="1.35242894s" podCreationTimestamp="2026-05-21 18:31:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:31:53.349124666 +0000 UTC m=+1595.600637097" watchObservedRunningTime="2026-05-21 18:31:53.35242894 +0000 UTC m=+1595.603941382"
May 21 18:32:04.329095 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:32:04.329062    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m88tb"
May 21 18:41:41.251339 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:41.251305    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-78c69f4c5-9z9pp_8cb7f9a0-e59a-46f8-93e5-fc95789b1075/maas-api/0.log"
May 21 18:41:41.365764 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:41.365734    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66b9dd549b-zbngn_f276e1b0-7931-4df8-b2be-5600b7dd61dd/manager/0.log"
May 21 18:41:41.843754 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:41.843717    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d88b9bb7c-t88v7_87db80f1-823a-4b33-a8ad-64625e37caad/manager/0.log"
May 21 18:41:41.952272 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:41.952229    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mq468_9236f96a-cd16-47a2-a862-94e4da576ccb/postgres/0.log"
May 21 18:41:43.534919 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:43.534892    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qjsrl_f61b3b80-9967-41ef-a2ec-8ca21d4a46cd/manager/0.log"
May 21 18:41:43.897998 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:43.897876    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m88tb_5675f6d6-4192-4306-a670-09a0e327ff67/manager/0.log"
May 21 18:41:44.502555 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:44.502523    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bszjkz_28a6f1fd-3724-4f59-b310-fc12556f1482/istio-proxy/0.log"
May 21 18:41:44.966845 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:44.966813    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ljwls_578f29a3-7b95-4556-a03f-cf982d495a46/istio-proxy/0.log"
May 21 18:41:45.561025 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:45.561002    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8_76d92991-c985-4836-8cc2-16a03cc61ca9/storage-initializer/0.log"
May 21 18:41:45.568124 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:45.568102    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-nczf8_76d92991-c985-4836-8cc2-16a03cc61ca9/main/0.log"
May 21 18:41:45.677548 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:45.677525    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk_3478d5f3-4390-4014-bf5a-19011b9a9893/storage-initializer/0.log"
May 21 18:41:45.684608 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:45.684580    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-q42kk_3478d5f3-4390-4014-bf5a-19011b9a9893/main/0.log"
May 21 18:41:46.156995 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:46.156963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb_28abe6ec-e8bd-4201-b7a7-f67ced2f0533/storage-initializer/0.log"
May 21 18:41:46.163720 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:46.163700    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-rnjqb_28abe6ec-e8bd-4201-b7a7-f67ced2f0533/main/0.log"
May 21 18:41:50.100067 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.100026    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zgqt/must-gather-qt8t2"]
May 21 18:41:50.103463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.103446    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.106220 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.106192    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zgqt\"/\"kube-root-ca.crt\""
May 21 18:41:50.107164 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.107145    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zgqt\"/\"openshift-service-ca.crt\""
May 21 18:41:50.107263 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.107156    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9zgqt\"/\"default-dockercfg-x9c5l\""
May 21 18:41:50.118553 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.118525    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zgqt/must-gather-qt8t2"]
May 21 18:41:50.205202 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.205175    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r28z\" (UniqueName: \"kubernetes.io/projected/72d88c49-f12a-4b9f-89c6-872ede06e599-kube-api-access-4r28z\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.205318 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.205221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d88c49-f12a-4b9f-89c6-872ede06e599-must-gather-output\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.306313 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.306281    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r28z\" (UniqueName: \"kubernetes.io/projected/72d88c49-f12a-4b9f-89c6-872ede06e599-kube-api-access-4r28z\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.306463 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.306343    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d88c49-f12a-4b9f-89c6-872ede06e599-must-gather-output\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.306711 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.306693    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d88c49-f12a-4b9f-89c6-872ede06e599-must-gather-output\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.313771 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.313749    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r28z\" (UniqueName: \"kubernetes.io/projected/72d88c49-f12a-4b9f-89c6-872ede06e599-kube-api-access-4r28z\") pod \"must-gather-qt8t2\" (UID: \"72d88c49-f12a-4b9f-89c6-872ede06e599\") " pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.412148 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.412089    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zgqt/must-gather-qt8t2"
May 21 18:41:50.533322 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.533173    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zgqt/must-gather-qt8t2"]
May 21 18:41:50.535894 ip-10-0-133-143 kubenswrapper[2557]: W0521 18:41:50.535870    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72d88c49_f12a_4b9f_89c6_872ede06e599.slice/crio-f798067465d692d5d59fd753db47df068fd92021a218c6afd39d77741daf1e63 WatchSource:0}: Error finding container f798067465d692d5d59fd753db47df068fd92021a218c6afd39d77741daf1e63: Status 404 returned error can't find the container with id f798067465d692d5d59fd753db47df068fd92021a218c6afd39d77741daf1e63
May 21 18:41:50.537723 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:50.537707    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:41:51.257877 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:51.257845    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zgqt/must-gather-qt8t2" event={"ID":"72d88c49-f12a-4b9f-89c6-872ede06e599","Type":"ContainerStarted","Data":"f798067465d692d5d59fd753db47df068fd92021a218c6afd39d77741daf1e63"}
May 21 18:41:52.266713 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:52.265863    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zgqt/must-gather-qt8t2" event={"ID":"72d88c49-f12a-4b9f-89c6-872ede06e599","Type":"ContainerStarted","Data":"e2d0aa2947f0fac1cc67a57d55e19afaff1dd9438e477c630771516a4cdaeb5f"}
May 21 18:41:52.266713 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:52.265914    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zgqt/must-gather-qt8t2" event={"ID":"72d88c49-f12a-4b9f-89c6-872ede06e599","Type":"ContainerStarted","Data":"c86b8b2f7344c5a214af2f43e551a214bd62daf38ae04ad49e3af1cb849e25af"}
May 21 18:41:52.285555 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:52.285491    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9zgqt/must-gather-qt8t2" podStartSLOduration=1.238194844 podStartE2EDuration="2.285472339s" podCreationTimestamp="2026-05-21 18:41:50 +0000 UTC" firstStartedPulling="2026-05-21 18:41:50.537831832 +0000 UTC m=+2192.789344252" lastFinishedPulling="2026-05-21 18:41:51.585109325 +0000 UTC m=+2193.836621747" observedRunningTime="2026-05-21 18:41:52.2838075 +0000 UTC m=+2194.535319942" watchObservedRunningTime="2026-05-21 18:41:52.285472339 +0000 UTC m=+2194.536984782"
May 21 18:41:53.226927 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:53.226893    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hx4b4_3672563a-2a58-41ef-b74b-6b0804e55d2c/global-pull-secret-syncer/0.log"
May 21 18:41:53.323403 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:53.323379    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2282w_2162043b-4854-47bd-8cbb-15e63d7bec35/konnectivity-agent/0.log"
May 21 18:41:53.422180 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:53.422149    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-143.ec2.internal_12ba3cafa5e44bfecf51edb64109fc5d/haproxy/0.log"
May 21 18:41:57.354194 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:57.354088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qjsrl_f61b3b80-9967-41ef-a2ec-8ca21d4a46cd/manager/0.log"
May 21 18:41:57.507692 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:57.507622    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m88tb_5675f6d6-4192-4306-a670-09a0e327ff67/manager/0.log"
May 21 18:41:59.454636 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:59.454573    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsrcv_dc3590f1-fe55-468d-88ae-975baf0b07d6/node-exporter/0.log"
May 21 18:41:59.482020 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:59.481990    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsrcv_dc3590f1-fe55-468d-88ae-975baf0b07d6/kube-rbac-proxy/0.log"
May 21 18:41:59.502278 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:41:59.502254    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsrcv_dc3590f1-fe55-468d-88ae-975baf0b07d6/init-textfile/0.log"
May 21 18:42:01.797823 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.797784    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"]
May 21 18:42:01.803138 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.803111    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:01.813597 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.813565    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"]
May 21 18:42:01.943530 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.943485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-lib-modules\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:01.943773 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.943569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-podres\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:01.943773 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.943602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-proc\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:01.943773 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.943682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-sys\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:01.943773 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:01.943751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xs8q\" (UniqueName: \"kubernetes.io/projected/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-kube-api-access-4xs8q\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045326 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045283    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xs8q\" (UniqueName: \"kubernetes.io/projected/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-kube-api-access-4xs8q\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045365    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-lib-modules\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045424    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-podres\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045450    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-proc\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045523 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045493    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-sys\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045613    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-sys\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045674    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-lib-modules\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045755 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045693    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-proc\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.045903 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.045791    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-podres\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.055402 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.055328    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xs8q\" (UniqueName: \"kubernetes.io/projected/434fbe77-7d4d-41a6-b5ba-1225432bc5b7-kube-api-access-4xs8q\") pod \"perf-node-gather-daemonset-r8h76\" (UID: \"434fbe77-7d4d-41a6-b5ba-1225432bc5b7\") " pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.116971 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.116457    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:02.311406 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.311022    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"]
May 21 18:42:02.333887 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:02.333849    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76" event={"ID":"434fbe77-7d4d-41a6-b5ba-1225432bc5b7","Type":"ContainerStarted","Data":"d3f3faccbc5149382061781c36c3f97afea08bba6c6229a4a97c1582258937d1"}
May 21 18:42:03.339512 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.339466    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76" event={"ID":"434fbe77-7d4d-41a6-b5ba-1225432bc5b7","Type":"ContainerStarted","Data":"3fa6238f23bbfd4cd77f4c2cda2f996b0138395010fe2a040dc2eb3baa6e5bd3"}
May 21 18:42:03.340019 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.339629    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:03.358429 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.358373    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76" podStartSLOduration=2.358354438 podStartE2EDuration="2.358354438s" podCreationTimestamp="2026-05-21 18:42:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:42:03.356200709 +0000 UTC m=+2205.607713162" watchObservedRunningTime="2026-05-21 18:42:03.358354438 +0000 UTC m=+2205.609866880"
May 21 18:42:03.699785 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.699720    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqbvt_81c44ccb-de29-4978-827c-6de3142a2802/dns/0.log"
May 21 18:42:03.724751 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.724724    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqbvt_81c44ccb-de29-4978-827c-6de3142a2802/kube-rbac-proxy/0.log"
May 21 18:42:03.896142 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:03.896110    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sl8cj_65df7f68-f12d-48f3-acf4-34e06ea221a2/dns-node-resolver/0.log"
May 21 18:42:04.483090 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:04.483063    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jcg4d_f92c236d-3ba9-4890-bcb0-992227a203a9/node-ca/0.log"
May 21 18:42:05.359467 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:05.359440    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bszjkz_28a6f1fd-3724-4f59-b310-fc12556f1482/istio-proxy/0.log"
May 21 18:42:05.557928 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:05.557899    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ljwls_578f29a3-7b95-4556-a03f-cf982d495a46/istio-proxy/0.log"
May 21 18:42:06.161266 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:06.161237    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7qxjp_8aefe2ca-5570-488d-ba33-ee1184bddead/serve-healthcheck-canary/0.log"
May 21 18:42:06.978518 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:06.978485    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl9q2_3f1fdaa6-d9b0-4925-9041-eb48b50aba4e/kube-rbac-proxy/0.log"
May 21 18:42:07.001716 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:07.001692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl9q2_3f1fdaa6-d9b0-4925-9041-eb48b50aba4e/exporter/0.log"
May 21 18:42:07.024946 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:07.024919    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl9q2_3f1fdaa6-d9b0-4925-9041-eb48b50aba4e/extractor/0.log"
May 21 18:42:08.925284 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:08.925253    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-78c69f4c5-9z9pp_8cb7f9a0-e59a-46f8-93e5-fc95789b1075/maas-api/0.log"
May 21 18:42:09.001369 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:09.001340    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66b9dd549b-zbngn_f276e1b0-7931-4df8-b2be-5600b7dd61dd/manager/0.log"
May 21 18:42:09.132759 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:09.132736    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d88b9bb7c-t88v7_87db80f1-823a-4b33-a8ad-64625e37caad/manager/0.log"
May 21 18:42:09.158293 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:09.158266    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mq468_9236f96a-cd16-47a2-a862-94e4da576ccb/postgres/0.log"
May 21 18:42:09.353509 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:09.353482    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9zgqt/perf-node-gather-daemonset-r8h76"
May 21 18:42:10.379227 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:10.379194    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6fd5f56d79-7f5dx_de4f69f6-2cfc-416e-aa75-ac593a55301a/manager/0.log"
May 21 18:42:10.465888 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:10.465855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-sqr7k_3b3e8d56-49fa-4966-83af-5667d13254b3/openshift-lws-operator/0.log"
May 21 18:42:16.249377 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.249346    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/kube-multus-additional-cni-plugins/0.log"
May 21 18:42:16.270690 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.270667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/egress-router-binary-copy/0.log"
May 21 18:42:16.294127 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.294101    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/cni-plugins/0.log"
May 21 18:42:16.314457 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.314437    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/bond-cni-plugin/0.log"
May 21 18:42:16.335053 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.335033    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/routeoverride-cni/0.log"
May 21 18:42:16.353298 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.353277    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/whereabouts-cni-bincopy/0.log"
May 21 18:42:16.373009 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.372991    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5d2r_923dadc4-29a6-4dab-8426-f17d19e8698b/whereabouts-cni/0.log"
May 21 18:42:16.734959 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.734926    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zx4s6_73007daa-d2c1-4772-84ff-16f19af37d04/kube-multus/0.log"
May 21 18:42:16.753739 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.753705    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9pxr6_fa94915c-fe1b-4cc6-a227-6c36aaac26f8/network-metrics-daemon/0.log"
May 21 18:42:16.772111 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:16.772063    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9pxr6_fa94915c-fe1b-4cc6-a227-6c36aaac26f8/kube-rbac-proxy/0.log"
May 21 18:42:17.683709 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.683678    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/ovn-controller/0.log"
May 21 18:42:17.712803 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.712775    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/ovn-acl-logging/0.log"
May 21 18:42:17.733549 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.733522    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/kube-rbac-proxy-node/0.log"
May 21 18:42:17.756402 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.756376    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/kube-rbac-proxy-ovn-metrics/0.log"
May 21 18:42:17.776429 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.776402    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/northd/0.log"
May 21 18:42:17.796252 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.796231    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/nbdb/0.log"
May 21 18:42:17.817234 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.817209    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/sbdb/0.log"
May 21 18:42:17.931141 ip-10-0-133-143 kubenswrapper[2557]: I0521 18:42:17.931115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vpsl_31ed2e73-a1eb-4782-9801-3844ca64dd6d/ovnkube-controller/0.log"