May 20 15:30:01.752903 ip-10-0-135-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 20 15:30:01.752913 ip-10-0-135-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 20 15:30:01.752921 ip-10-0-135-93 systemd[1]: kubelet.service: Failed with result 'resources'.
May 20 15:30:01.753153 ip-10-0-135-93 systemd[1]: Failed to start Kubernetes Kubelet.
May 20 15:30:13.128104 ip-10-0-135-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 20 15:30:13.128121 ip-10-0-135-93 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2c833a05e8054ef5b5df5c030129c794 --
May 20 15:32:31.815157 ip-10-0-135-93 systemd[1]: Starting Kubernetes Kubelet...
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:32:32.328935 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.319290    2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329423    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329445    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329449    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329453    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329456    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329459    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329462    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329464    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329467    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329470    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329472    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329475    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329477    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329487    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329490    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329493    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329495    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329498    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329501    2559 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:32:32.329788 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329503    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329508    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329515    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329517    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329521    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329523    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329526    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329528    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329531    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329535    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329537    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329540    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329543    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329545    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329548    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329551    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329553    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329556    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329559    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329561    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:32:32.330393 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329564    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329567    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329569    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329571    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329574    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329576    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329579    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329583    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329587    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329590    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329593    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329596    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329599    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329602    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329605    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329608    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329611    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329613    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329616    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329619    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:32:32.331050 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329622    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329625    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329628    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329631    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329634    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329636    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329640    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329645    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329648    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329651    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329654    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329657    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329660    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329663    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329667    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329670    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329673    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329677    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329680    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:32:32.331613 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329684    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329686    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329689    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329692    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329695    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329698    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329701    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.329703    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330164    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330170    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330173    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330176    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330179    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330182    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330185    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330188    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330191    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330195    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330198    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:32:32.332285 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330201    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330204    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330206    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330209    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330211    2559 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330214    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330217    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330220    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330223    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330226    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330228    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330231    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330234    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330237    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330239    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330242    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330245    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330247    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330250    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330252    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:32:32.332816 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330255    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330258    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330260    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330262    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330265    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330268    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330270    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330273    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330276    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330278    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330281    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330285    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330289    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330292    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330294    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330297    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330300    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330302    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330306    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:32:32.333594 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330309    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330313    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330316    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330319    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330322    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330324    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330327    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330330    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330333    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330335    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330338    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330340    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330343    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330345    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330348    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330350    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330353    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330355    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330357    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:32:32.334206 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330360    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330363    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330365    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330369    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330371    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330374    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330376    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330379    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330381    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330384    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330387    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330389    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330391    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330394    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330397    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330400    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.330402    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330484    2559 flags.go:64] FLAG: --address="0.0.0.0"
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330492    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330499    2559 flags.go:64] FLAG: --anonymous-auth="true"
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330503    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 15:32:32.334893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330508    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330512    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330516    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330521    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330524    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330527    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330531    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330534    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330537    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330540    2559 flags.go:64] FLAG: --cgroup-root=""
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330544    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330547    2559 flags.go:64] FLAG: --client-ca-file=""
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330550    2559 flags.go:64] FLAG: --cloud-config=""
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330553    2559 flags.go:64] FLAG: --cloud-provider="external"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330555    2559 flags.go:64] FLAG: --cluster-dns="[]"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330559    2559 flags.go:64] FLAG: --cluster-domain=""
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330562    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330565    2559 flags.go:64] FLAG: --config-dir=""
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330568    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330571    2559 flags.go:64] FLAG: --container-log-max-files="5"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330576    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330579    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330582    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330585    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 15:32:32.335486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330588    2559 flags.go:64] FLAG: --contention-profiling="false"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330592    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330595    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330598    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330601    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330605    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330609    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330611    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330615    2559 flags.go:64] FLAG: --enable-load-reader="false"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330621    2559 flags.go:64] FLAG: --enable-server="true"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330624    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330628    2559 flags.go:64] FLAG: --event-burst="100"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330632    2559 flags.go:64] FLAG: --event-qps="50"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330635    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330638    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330641    2559 flags.go:64] FLAG: --eviction-hard=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330645    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330647    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330650    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330653    2559 flags.go:64] FLAG: --eviction-soft=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330656    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330659    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330663    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330665    2559 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330668    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 15:32:32.336426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330671    2559 flags.go:64] FLAG: --fail-swap-on="true"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330674    2559 flags.go:64] FLAG: --feature-gates=""
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330678    2559 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330681    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330684    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330687    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330690    2559 flags.go:64] FLAG: --healthz-port="10248"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330694    2559 flags.go:64] FLAG: --help="false"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330697    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-93.ec2.internal"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330700    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330703    2559 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330706    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330710    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330713    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330716    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330719    2559 flags.go:64] FLAG: --image-service-endpoint=""
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330723    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330728    2559 flags.go:64] FLAG: --kube-api-burst="100"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330731    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330734    2559 flags.go:64] FLAG: --kube-api-qps="50"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330737    2559 flags.go:64] FLAG: --kube-reserved=""
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330740    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330747    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 15:32:32.337137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330750    2559 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330753    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330756    2559 flags.go:64] FLAG: --lock-file=""
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330759    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330762    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330765    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330770    2559 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330773    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330776    2559 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330779    2559 flags.go:64] FLAG: --logging-format="text"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330782    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330785    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330788    2559 flags.go:64] FLAG: --manifest-url=""
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330790    2559 flags.go:64] FLAG: --manifest-url-header=""
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330794    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330797    2559 flags.go:64] FLAG: --max-open-files="1000000"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330801    2559 flags.go:64] FLAG: --max-pods="110"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330804    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330807    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330810    2559 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330813    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330817    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330820    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330823    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330846    2559 flags.go:64] FLAG: --node-status-max-images="50"
May 20 15:32:32.338089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330852    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330856    2559 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330860    2559 flags.go:64] FLAG: --pod-cidr=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330863    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330868    2559 flags.go:64] FLAG: --pod-manifest-path=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330871    2559 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330876    2559 flags.go:64] FLAG: --pods-per-core="0"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330879    2559 flags.go:64] FLAG: --port="10250"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330882    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330885    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4d8d2ef2531dd01"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330888    2559 flags.go:64] FLAG: --qos-reserved=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330892    2559 flags.go:64] FLAG: --read-only-port="10255"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330895    2559 flags.go:64] FLAG: --register-node="true"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330897    2559 flags.go:64] FLAG: --register-schedulable="true"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330900    2559 flags.go:64] FLAG: --register-with-taints=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330904    2559 flags.go:64] FLAG: --registry-burst="10"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330907    2559 flags.go:64] FLAG: --registry-qps="5"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330910    2559 flags.go:64] FLAG: --reserved-cpus=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330913    2559 flags.go:64] FLAG: --reserved-memory=""
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330917    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330920    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330923    2559 flags.go:64] FLAG: --rotate-certificates="false"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330926    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330929    2559 flags.go:64] FLAG: --runonce="false"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330932    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 15:32:32.511376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330935    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 15:32:32.435268 ip-10-0-135-93 systemd[1]: Started Kubernetes Kubelet.
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330937    2559 flags.go:64] FLAG: --seccomp-default="false"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330940    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330943    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330946    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330949    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330952    2559 flags.go:64] FLAG: --storage-driver-password="root"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330955    2559 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330959    2559 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330962    2559 flags.go:64] FLAG: --storage-driver-user="root"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330966    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330969    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330972    2559 flags.go:64] FLAG: --system-cgroups=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330977    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330982    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330985    2559 flags.go:64] FLAG: --tls-cert-file=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330988    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330991    2559 flags.go:64] FLAG: --tls-min-version=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330994    2559 flags.go:64] FLAG: --tls-private-key-file=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330996    2559 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.330999    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331002    2559 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331005    2559 flags.go:64] FLAG: --v="2"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331009    2559 flags.go:64] FLAG: --version="false"
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331014    2559 flags.go:64] FLAG: --vmodule=""
May 20 15:32:32.528267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331018    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331022    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331121    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331125    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331129    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331131    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331134    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331137    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331140    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331143    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331145    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331148    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331151    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331153    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331156    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331161    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331163    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331166    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331169    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331171    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:32:32.529251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331174    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331177    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331180    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331182    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331185    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331188    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331190    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331193    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331196    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331198    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331201    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331203    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331206    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331208    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331211    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331213    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331216    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331218    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331221    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:32:32.530091 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331223    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331226    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331228    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331231    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331235    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331238    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331241    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331244    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331248    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331251    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331253    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331256    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331259    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331261    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331264    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331266    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331269    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331272    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331274    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:32:32.530794 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331276    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331279    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331281    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331284    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331286    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331288    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331291    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331294    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331296    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331298    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331301    2559 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331303    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331306    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331309    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331312    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331314    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331317    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331319    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331321    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331324    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:32:32.531778 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331327    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331331    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331335    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331338    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331341    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331343    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331349    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331352    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331354    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.331357    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.331362    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.337564    2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.337689    2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337741    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337746    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337750    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:32:32.532440 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337753    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337756    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337760    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337763    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337766    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337769    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337771    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337774    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337777    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337779    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337782    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337785    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337788    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337790    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337793    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337795    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337798    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337801    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337804    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337807    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:32:32.533275 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337809    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337813    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337815    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337818    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337821    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337823    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337860    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337867    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337874    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337877    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337880    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337882    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337885    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337888    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337891    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337893    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337896    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337900    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337905    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337907    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:32:32.533948 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337910    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337913    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337916    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337919    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337921    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337925    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337928    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337931    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337934    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337937    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337940    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337943    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337945    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337948    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337951    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337953    2559 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337956    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337958    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337961    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337963    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:32:32.536633 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337966    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337970    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337981    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337986    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337989    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337992    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337995    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.337997    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338000    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338003    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338006    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338008    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338011    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338014    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338017    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338019    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338022    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338024    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338027    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:32:32.537724 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338030    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338032    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338035    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338038    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.338043    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338156    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338162    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338164    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338167    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338170    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338173    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338175    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338178    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338181    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338183    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338187    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:32:32.539961 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338189    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338192    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338195    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338198    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338200    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338203    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338206    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338209    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338211    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338214    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338217    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338219    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338222    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338224    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338227    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338230    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338232    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338235    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338238    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338240    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:32:32.540842 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338244    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338246    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338249    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338251    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338254    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338256    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338259    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338261    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338263    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338269    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338271    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338274    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338276    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338279    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338281    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338284    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338287    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338289    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338291    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338294    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:32:32.856251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338296    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338300    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338303    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338306    2559 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338309    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338311    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338314    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338316    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338318    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338321    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338324    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338326    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338329    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338331    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338334    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338337    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338339    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338342    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338344    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338346    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:32:32.857445 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338349    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338354    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338357    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338361    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338364    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338367    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338369    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338372    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338375    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338377    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338380    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338382    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338384    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338387    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:32.338389    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:32:32.859946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.338395    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.339061    2559 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.341711    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.342645    2559 server.go:1019] "Starting client certificate rotation"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.342755    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.343527    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.369395    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.371629    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.392367    2559 log.go:25] "Validated CRI v1 runtime API"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.399328    2559 log.go:25] "Validated CRI v1 image API"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.402731    2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.403669    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 15:32:32.860416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.406725    2559 fs.go:135] Filesystem UUIDs: map[018b4245-709f-44d0-8f87-c05a17a1ef49:/dev/nvme0n1p3 70d418bf-0476-40e7-a71b-213e8a728b14:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 20 15:32:32.860785 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.406748    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.411464    2559 manager.go:217] Machine: {Timestamp:2026-05-20 15:32:32.410953313 +0000 UTC m=+0.462632760 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499996 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f75bfe58383f220311d54c576119c SystemUUID:ec2f75bf-e583-83f2-2031-1d54c576119c BootID:2c833a05-e805-4ef5-b5df-5c030129c794 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:b8:0a:52:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:b8:0a:52:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:dc:e5:75:d8:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.412253    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.412402    2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.414952    2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.414983    2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.415136    2559 topology_manager.go:138] "Creating topology manager with none policy"
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.415145    2559 container_manager_linux.go:306] "Creating device plugin manager"
May 20 15:32:32.861119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.415152    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.415957    2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.417867    2559 state_mem.go:36] "Initialized new in-memory state store"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.418006    2559 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.420524    2559 kubelet.go:491] "Attempting to sync node with API server"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.420541    2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.420553    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.420563    2559 kubelet.go:397] "Adding apiserver pod source"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.420572    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.421716    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.421733    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.425152    2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.427426    2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.428959    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.428974    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.428981    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.428988    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.428999    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429008    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429016    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429022    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429031    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429042    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429054    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.429064    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.430166    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.430177    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.433444    2559 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.433481    2559 server.go:1295] "Started kubelet"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.433517    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.433544    2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.433593    2559 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.435569    2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.435916    2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.436997    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.436998    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 15:32:32.861433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.439304    2559 server.go:317] "Adding debug handlers to kubelet server"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.442930    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-93.ec2.internal.18b14fe044ca97ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-93.ec2.internal,UID:ip-10-0-135-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-93.ec2.internal,},FirstTimestamp:2026-05-20 15:32:32.433453055 +0000 UTC m=+0.485132506,LastTimestamp:2026-05-20 15:32:32.433453055 +0000 UTC m=+0.485132506,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-93.ec2.internal,}"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.444478    2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444486    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444517    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444572    2559 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444586    2559 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444662    2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444741    2559 reconstruct.go:97] "Volume reconstruction finished"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.444747    2559 reconciler.go:26] "Reconciler: start to sync state"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.445499    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.445663    2559 factory.go:55] Registering systemd factory
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.445688    2559 factory.go:223] Registration of the systemd container factory successfully
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446045    2559 factory.go:153] Registering CRI-O factory
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446063    2559 factory.go:223] Registration of the crio container factory successfully
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446123    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446143    2559 factory.go:103] Registering Raw factory
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446157    2559 manager.go:1196] Started watching for new ooms in manager
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.446569    2559 manager.go:319] Starting recovery of all containers
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.451951    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xkjq"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.456326    2559 manager.go:324] Recovery completed
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.457903    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.460843    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xkjq"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.460986    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.463592    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.463621    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.463632    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.464148    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.464158    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.464173    2559 state_mem.go:36] "Initialized new in-memory state store"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.466920    2559 policy_none.go:49] "None policy: Start"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.466940    2559 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.466951    2559 state_mem.go:35] "Initializing new in-memory state store"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.470719    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.525538    2559 manager.go:341] "Starting Device Plugin manager"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.525632    2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 15:32:32.862427 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.525647    2559 server.go:85] "Starting device plugin registration server"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.525947    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.525962    2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.526054    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.526159    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.526167    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.526694    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.526730    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.557783    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.559102    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.559132    2559 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.559157    2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.559164    2559 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.559267    2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.561736    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.626740    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.628023    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.628054    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.628064    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.628091    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-93.ec2.internal"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.641196    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-93.ec2.internal"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.641222    2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-93.ec2.internal\": node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.659366    2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"]
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.659437    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.660960    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.660985    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.660997    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.662155    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.662302    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.662329    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663051    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663073    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663085    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663377    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663398    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.863497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.663411    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.664775    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.664802    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.665431    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.665451    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.665462    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeHasSufficientPID"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.677302    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.684448    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-93.ec2.internal\" not found" node="ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.688846    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-93.ec2.internal\" not found" node="ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.746717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.746744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.746761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ef9e18c43a8b05285be032dd09ab0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-93.ec2.internal\" (UID: \"9ef9e18c43a8b05285be032dd09ab0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.777606    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.846871    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.846898    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.846919    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ef9e18c43a8b05285be032dd09ab0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-93.ec2.internal\" (UID: \"9ef9e18c43a8b05285be032dd09ab0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.846964    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.846977    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8dd2018b516a9a3436de70b65c5df3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal\" (UID: \"d8dd2018b516a9a3436de70b65c5df3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:32.864453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.847007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ef9e18c43a8b05285be032dd09ab0b2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-93.ec2.internal\" (UID: \"9ef9e18c43a8b05285be032dd09ab0b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:33.160192 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.878176    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.160192 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:32.979021    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.160192 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.987162    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:33.160192 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:32.990993    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:33.160192 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.079479    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.364345 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.179956    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.364345 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.280458    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.364345 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.342657    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 15:32:33.364345 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.342870    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 15:32:33.364345 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.342897    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 15:32:33.381279 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.381251    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-93.ec2.internal\" not found"
May 20 15:32:33.408257 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.408227    2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:33.421456 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.421377    2559 apiserver.go:52] "Watching apiserver"
May 20 15:32:33.430634 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.430609    2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 15:32:33.432285 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.432263    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nnmvl","openshift-multus/multus-additional-cni-plugins-sgjpt","openshift-multus/multus-tzc97","openshift-multus/network-metrics-daemon-lflkp","openshift-ovn-kubernetes/ovnkube-node-nmwf4","kube-system/konnectivity-agent-kpk94","openshift-cluster-node-tuning-operator/tuned-5pdf2","openshift-dns/node-resolver-mdr68","openshift-network-diagnostics/network-check-target-l6ddl","openshift-network-operator/iptables-alerter-x8gtc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"]
May 20 15:32:33.434400 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.434377    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.436714 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.436692    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzc97"
May 20 15:32:33.436815 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.436763    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.437358 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.437337    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pmln2\""
May 20 15:32:33.437484 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.437470    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 15:32:33.437573 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.437473    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 15:32:33.437573 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.437473    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 15:32:33.438258 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.438239    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.438341 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.438319    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:33.439196 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439173    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d8dw7\""
May 20 15:32:33.439358 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439343    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 15:32:33.439445 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439355    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.439445 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439370    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6th5d\""
May 20 15:32:33.439507 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439476    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 15:32:33.439507 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439488    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 15:32:33.439701 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439685    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 15:32:33.439820 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439804    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 15:32:33.439931 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.439918    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 15:32:33.440405 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.440387    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.441371 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.441345    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.441818 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.441786    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 15:32:33.441929 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.441788    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 15:32:33.441929 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.441809    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 15:32:33.442291 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442275    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 15:32:33.442391 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442297    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 15:32:33.442391 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442370    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-25kvr\""
May 20 15:32:33.442502 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442417    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 15:32:33.442502 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442446    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.442682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442659    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wkl88\""
May 20 15:32:33.442752 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442720    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 15:32:33.442797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.442781    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 15:32:33.443556 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.443540    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:33.443641 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.443591    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:33.443748 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.443732    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkbwl\""
May 20 15:32:33.443791 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.443755    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 15:32:33.443864 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.443848    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 15:32:33.444583 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.444569    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.444667 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.444652    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 15:32:33.444842 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.444657    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"
May 20 15:32:33.445903 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.445886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.447673 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.447655    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 15:32:33.447876 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.447863    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xv7q2\""
May 20 15:32:33.449497 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.449483    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 15:32:33.450893 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.450875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-tmp\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.450966 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.450910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.450966 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.450936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhzb5\" (UniqueName: \"kubernetes.io/projected/fa286413-633d-415f-86e3-c155eb12282e-kube-api-access-dhzb5\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.451068 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjv9\" (UniqueName: \"kubernetes.io/projected/240ce8a6-a8de-4400-98cb-cb44bb63e032-kube-api-access-pbjv9\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.451068 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-socket-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.451135 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-hostroot\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.451135 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-systemd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.451200 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-netd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.451200 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.451261 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-registration-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.451431 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-cnibin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.451491 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-netns\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.451567 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-bin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.451567 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-bin\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.451654 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-config\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.451654 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovn-node-metrics-cert\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.451654 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nh8\" (UniqueName: \"kubernetes.io/projected/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-kube-api-access-q7nh8\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.451773 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-systemd\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.451881 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-sys\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.451950 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-lib-modules\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.452000 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285708ba-11b4-4be0-812b-48e038f64023-konnectivity-ca\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.452046 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.451995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-host-slash\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.452046 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-system-cni-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.452132 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.452226 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-socket-dir-parent\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.452319 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-netns\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.452319 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa286413-633d-415f-86e3-c155eb12282e-tmp-dir\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.452445 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-conf-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.452445 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-multus-certs\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.452445 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7ln\" (UniqueName: \"kubernetes.io/projected/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-kube-api-access-2p7ln\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.452577 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452441    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 15:32:33.452577 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-system-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.452577 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-var-lib-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.452699 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.452699 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-serviceca\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.452699 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285708ba-11b4-4be0-812b-48e038f64023-agent-certs\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.452865 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-modprobe-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.452865 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqgzb\" (UniqueName: \"kubernetes.io/projected/181580ea-035f-4dec-bcae-eb826cdbd2ad-kube-api-access-bqgzb\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.452946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjx6\" (UniqueName: \"kubernetes.io/projected/b633256f-cf71-47cc-8224-0bb5a10ff4c6-kube-api-access-6sjx6\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.452946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-ovn\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453033 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.452976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453033 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-run\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.453123 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-var-lib-kubelet\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.453123 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-sys-fs\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.453222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5kn\" (UniqueName: \"kubernetes.io/projected/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kube-api-access-sq5kn\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.453222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-node-log\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-env-overrides\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-tuned\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-cni-binary-copy\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-systemd-units\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cnibin\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.453392 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-os-release\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-multus\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-etc-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hjf\" (UniqueName: \"kubernetes.io/projected/a6f1c997-0fca-4936-990f-7faa4e9f33cd-kube-api-access-22hjf\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-kubernetes\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-script-lib\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453697    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g64qs\""
May 20 15:32:33.453822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453815    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453851    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453700    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.453698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysconfig\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-etc-kubernetes\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-slash\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa286413-633d-415f-86e3-c155eb12282e-hosts-file\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.454264 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454270    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hs8l6\""
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-host\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-host\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-iptables-alerter-script\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454413    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-device-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454516    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.454632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-os-release\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-kubelet\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-kubelet\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-daemon-config\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-conf\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.454976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6d5\" (UniqueName: \"kubernetes.io/projected/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-kube-api-access-xk6d5\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.455035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-k8s-cni-cncf-io\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.455139 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.455081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-log-socket\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.463472 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.463438    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 15:27:32 +0000 UTC" deadline="2027-12-10 13:01:46.299867735 +0000 UTC"
May 20 15:32:33.463472 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.463471    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13653h29m12.836399989s"
May 20 15:32:33.464782 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.464766    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 15:32:33.483019 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.482983    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal"]
May 20 15:32:33.483552 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.483537    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 15:32:33.483630 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.483620    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"
May 20 15:32:33.516167 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.516145    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 15:32:33.516314 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.516193    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal"]
May 20 15:32:33.522111 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.522082    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlc65"
May 20 15:32:33.532882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.532853    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlc65"
May 20 15:32:33.545553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.545523    2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 15:32:33.555978 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.555951    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysconfig\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.555978 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.555979    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.555996    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-etc-kubernetes\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556011    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-slash\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556026    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa286413-633d-415f-86e3-c155eb12282e-hosts-file\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556055    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556075    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-host\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556076    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-etc-kubernetes\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556093    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-host\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556091    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysconfig\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556121    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa286413-633d-415f-86e3-c155eb12282e-hosts-file\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556126    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-iptables-alerter-script\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556140    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-host\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556148    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.556151 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-slash\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556167    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-device-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556191    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-host\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556219    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556290    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556310    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-device-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556322    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556365    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556421    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-os-release\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556452    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-kubelet\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556480    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556500    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556509    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-kubelet\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556531    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-kubelet\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.556682 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556541    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-os-release\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556550    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-daemon-config\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556588    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-conf\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556548    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-kubelet\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556617    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6d5\" (UniqueName: \"kubernetes.io/projected/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-kube-api-access-xk6d5\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556646    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-k8s-cni-cncf-io\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556671    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-log-socket\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556713    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-log-socket\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556714    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-conf\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556755    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-k8s-cni-cncf-io\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-tmp\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556878    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556926    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhzb5\" (UniqueName: \"kubernetes.io/projected/fa286413-633d-415f-86e3-c155eb12282e-kube-api-access-dhzb5\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556954    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjv9\" (UniqueName: \"kubernetes.io/projected/240ce8a6-a8de-4400-98cb-cb44bb63e032-kube-api-access-pbjv9\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.557308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556967    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556980    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-socket-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.556993    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.557007    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557002    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-iptables-alerter-script\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557011    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-hostroot\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557042    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-hostroot\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.557090    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:34.057052374 +0000 UTC m=+2.108731835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-daemon-config\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557109    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-systemd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557135    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-socket-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557137    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-netd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557167    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-systemd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557158    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 15:32:33.557889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557169    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557217    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-registration-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557249    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-cnibin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557274    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-netns\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557281    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-sysctl-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-registration-dir\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557305    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-bin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557304    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-cnibin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557326    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-netns\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557167    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-netd\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557328    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-bin\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557356    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-cni-bin\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557359    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-config\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557362    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-bin\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557387    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovn-node-metrics-cert\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.558586 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557413    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nh8\" (UniqueName: \"kubernetes.io/projected/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-kube-api-access-q7nh8\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557438    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-systemd\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557462    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-sys\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557481    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-lib-modules\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557506    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285708ba-11b4-4be0-812b-48e038f64023-konnectivity-ca\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557572    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-systemd\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557615    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-sys\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557655    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-lib-modules\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557660    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-host-slash\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557941    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-config\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557944    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-system-cni-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-host-slash\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.557986    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558018    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-socket-dir-parent\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/285708ba-11b4-4be0-812b-48e038f64023-konnectivity-ca\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558048    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-netns\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558033    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-system-cni-dir\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558076    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa286413-633d-415f-86e3-c155eb12282e-tmp-dir\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558086    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-socket-dir-parent\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558102    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-conf-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558097    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-netns\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558129    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-multus-certs\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558146    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-multus-conf-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558156    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7ln\" (UniqueName: \"kubernetes.io/projected/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-kube-api-access-2p7ln\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558180    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-system-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558182    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-run-multus-certs\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558203    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-var-lib-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558249    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558259    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-system-cni-dir\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558277    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-serviceca\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.560124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558304    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285708ba-11b4-4be0-812b-48e038f64023-agent-certs\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-var-lib-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558327    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-modprobe-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558360    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqgzb\" (UniqueName: \"kubernetes.io/projected/181580ea-035f-4dec-bcae-eb826cdbd2ad-kube-api-access-bqgzb\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558386    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjx6\" (UniqueName: \"kubernetes.io/projected/b633256f-cf71-47cc-8224-0bb5a10ff4c6-kube-api-access-6sjx6\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558416    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-ovn\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558425    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa286413-633d-415f-86e3-c155eb12282e-tmp-dir\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558441    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558467    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-run\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558495    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-var-lib-kubelet\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558487    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558521    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-sys-fs\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558556    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5kn\" (UniqueName: \"kubernetes.io/projected/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kube-api-access-sq5kn\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558584    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-node-log\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.560789 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558611    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-env-overrides\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558635    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-tuned\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558658    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558687    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-cni-binary-copy\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558689    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-serviceca\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558735    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-modprobe-d\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558742    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-sys-fs\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558859    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-systemd-units\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558877    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-run-ovn\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558894    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cnibin\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558927    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-os-release\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558949    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-multus\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558986    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-run\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.558988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-etc-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559012    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-etc-openvswitch\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559032    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22hjf\" (UniqueName: \"kubernetes.io/projected/a6f1c997-0fca-4936-990f-7faa4e9f33cd-kube-api-access-22hjf\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559063    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-systemd-units\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559063    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-kubernetes\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559103    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-kubernetes\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559146    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-os-release\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559180    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/181580ea-035f-4dec-bcae-eb826cdbd2ad-host-var-lib-cni-multus\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559187    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-cnibin\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559202    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/181580ea-035f-4dec-bcae-eb826cdbd2ad-cni-binary-copy\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559236    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/240ce8a6-a8de-4400-98cb-cb44bb63e032-var-lib-kubelet\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559101    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.561882 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559492    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-script-lib\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559545    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6f1c997-0fca-4936-990f-7faa4e9f33cd-node-log\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.559775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-env-overrides\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.560042    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovnkube-script-lib\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.560333    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-tmp\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.561605    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/240ce8a6-a8de-4400-98cb-cb44bb63e032-etc-tuned\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.561659    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6f1c997-0fca-4936-990f-7faa4e9f33cd-ovn-node-metrics-cert\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.562501 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.561894    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/285708ba-11b4-4be0-812b-48e038f64023-agent-certs\") pod \"konnectivity-agent-kpk94\" (UID: \"285708ba-11b4-4be0-812b-48e038f64023\") " pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.568967 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.568101    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:33.568967 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.568131    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:33.568967 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.568145    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:33.568967 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:33.568231    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:32:34.068210988 +0000 UTC m=+2.119890448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:33.569951 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.569925    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nh8\" (UniqueName: \"kubernetes.io/projected/cc112da5-ca7b-43dc-9971-ebc1d7d7c14c-kube-api-access-q7nh8\") pod \"node-ca-nnmvl\" (UID: \"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c\") " pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.573077 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.573046    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7ln\" (UniqueName: \"kubernetes.io/projected/4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10-kube-api-access-2p7ln\") pod \"iptables-alerter-x8gtc\" (UID: \"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10\") " pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575236    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6d5\" (UniqueName: \"kubernetes.io/projected/abb53c6b-e8a4-4542-ba66-9bed7765c0f1-kube-api-access-xk6d5\") pod \"multus-additional-cni-plugins-sgjpt\" (UID: \"abb53c6b-e8a4-4542-ba66-9bed7765c0f1\") " pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575304    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhzb5\" (UniqueName: \"kubernetes.io/projected/fa286413-633d-415f-86e3-c155eb12282e-kube-api-access-dhzb5\") pod \"node-resolver-mdr68\" (UID: \"fa286413-633d-415f-86e3-c155eb12282e\") " pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575355    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjx6\" (UniqueName: \"kubernetes.io/projected/b633256f-cf71-47cc-8224-0bb5a10ff4c6-kube-api-access-6sjx6\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575466    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqgzb\" (UniqueName: \"kubernetes.io/projected/181580ea-035f-4dec-bcae-eb826cdbd2ad-kube-api-access-bqgzb\") pod \"multus-tzc97\" (UID: \"181580ea-035f-4dec-bcae-eb826cdbd2ad\") " pod="openshift-multus/multus-tzc97"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575675    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hjf\" (UniqueName: \"kubernetes.io/projected/a6f1c997-0fca-4936-990f-7faa4e9f33cd-kube-api-access-22hjf\") pod \"ovnkube-node-nmwf4\" (UID: \"a6f1c997-0fca-4936-990f-7faa4e9f33cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.575727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.575711    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5kn\" (UniqueName: \"kubernetes.io/projected/cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3-kube-api-access-sq5kn\") pod \"aws-ebs-csi-driver-node-hmfxg\" (UID: \"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.576238 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.576215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjv9\" (UniqueName: \"kubernetes.io/projected/240ce8a6-a8de-4400-98cb-cb44bb63e032-kube-api-access-pbjv9\") pod \"tuned-5pdf2\" (UID: \"240ce8a6-a8de-4400-98cb-cb44bb63e032\") " pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.587296 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.587274    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8gtc"
May 20 15:32:33.592252 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.592234    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg"
May 20 15:32:33.649601 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.649576    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:33.662097 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.662068    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef9e18c43a8b05285be032dd09ab0b2.slice/crio-ef48a27a1d2bdd92459bf9473376dc4583e1b2648de41fd9de771d38fc83a6e1 WatchSource:0}: Error finding container ef48a27a1d2bdd92459bf9473376dc4583e1b2648de41fd9de771d38fc83a6e1: Status 404 returned error can't find the container with id ef48a27a1d2bdd92459bf9473376dc4583e1b2648de41fd9de771d38fc83a6e1
May 20 15:32:33.662346 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.662325    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dd2018b516a9a3436de70b65c5df3e.slice/crio-8e8d9da30bce1dbf90632a6ea540ee986e05b2444ef7afc679961d540f958ff4 WatchSource:0}: Error finding container 8e8d9da30bce1dbf90632a6ea540ee986e05b2444ef7afc679961d540f958ff4: Status 404 returned error can't find the container with id 8e8d9da30bce1dbf90632a6ea540ee986e05b2444ef7afc679961d540f958ff4
May 20 15:32:33.666914 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.666893    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:32:33.760550 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.760301    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnmvl"
May 20 15:32:33.766253 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.766228    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc112da5_ca7b_43dc_9971_ebc1d7d7c14c.slice/crio-5ba879e2cc906f98ca8e4028a2bcbfb673e7c9da723d201913208bc8c0dc0c63 WatchSource:0}: Error finding container 5ba879e2cc906f98ca8e4028a2bcbfb673e7c9da723d201913208bc8c0dc0c63: Status 404 returned error can't find the container with id 5ba879e2cc906f98ca8e4028a2bcbfb673e7c9da723d201913208bc8c0dc0c63
May 20 15:32:33.777267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.777242    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzc97"
May 20 15:32:33.782863 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.782824    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181580ea_035f_4dec_bcae_eb826cdbd2ad.slice/crio-d676e2e66c84a1a715790f9826817223ea605f1664ade6b37865bfcba0d984b9 WatchSource:0}: Error finding container d676e2e66c84a1a715790f9826817223ea605f1664ade6b37865bfcba0d984b9: Status 404 returned error can't find the container with id d676e2e66c84a1a715790f9826817223ea605f1664ade6b37865bfcba0d984b9
May 20 15:32:33.795854 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.795814    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sgjpt"
May 20 15:32:33.801754 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.801728    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb53c6b_e8a4_4542_ba66_9bed7765c0f1.slice/crio-95a34b0dca0b35e0c8e61c43df5a140d89bffd58f8eb4eaf036a16a91c045c44 WatchSource:0}: Error finding container 95a34b0dca0b35e0c8e61c43df5a140d89bffd58f8eb4eaf036a16a91c045c44: Status 404 returned error can't find the container with id 95a34b0dca0b35e0c8e61c43df5a140d89bffd58f8eb4eaf036a16a91c045c44
May 20 15:32:33.818467 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.818443    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:33.824383 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.824350    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f1c997_0fca_4936_990f_7faa4e9f33cd.slice/crio-edca11bcc6c144f7926d24be329a19ccae31b7134bb1b2ec7c30926502f30f34 WatchSource:0}: Error finding container edca11bcc6c144f7926d24be329a19ccae31b7134bb1b2ec7c30926502f30f34: Status 404 returned error can't find the container with id edca11bcc6c144f7926d24be329a19ccae31b7134bb1b2ec7c30926502f30f34
May 20 15:32:33.832456 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.832434    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:33.838946 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.838917    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285708ba_11b4_4be0_812b_48e038f64023.slice/crio-f425ccdf58f0ad73102097d58df2abaaf281296f497617f6cf2a03c86de4a9a5 WatchSource:0}: Error finding container f425ccdf58f0ad73102097d58df2abaaf281296f497617f6cf2a03c86de4a9a5: Status 404 returned error can't find the container with id f425ccdf58f0ad73102097d58df2abaaf281296f497617f6cf2a03c86de4a9a5
May 20 15:32:33.843725 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.843706    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pdf2"
May 20 15:32:33.849963 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.849939    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240ce8a6_a8de_4400_98cb_cb44bb63e032.slice/crio-6217ec367d6456892244c2046f2ee193be3015760314f57953d9b3378289becc WatchSource:0}: Error finding container 6217ec367d6456892244c2046f2ee193be3015760314f57953d9b3378289becc: Status 404 returned error can't find the container with id 6217ec367d6456892244c2046f2ee193be3015760314f57953d9b3378289becc
May 20 15:32:33.860921 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:33.860899    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mdr68"
May 20 15:32:33.875401 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.875375    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa286413_633d_415f_86e3_c155eb12282e.slice/crio-306bd5919a756bceaeddc366aec1776ab15db1fc627eb9abac8790102cdbfd0c WatchSource:0}: Error finding container 306bd5919a756bceaeddc366aec1776ab15db1fc627eb9abac8790102cdbfd0c: Status 404 returned error can't find the container with id 306bd5919a756bceaeddc366aec1776ab15db1fc627eb9abac8790102cdbfd0c
May 20 15:32:33.875805 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:32:33.875782    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7b4bc5_8759_4c12_8fc8_5de0a2bba3f3.slice/crio-e416f20e1522c867ff31527e149afb238110911e058a247bb32caa9abcc935a6 WatchSource:0}: Error finding container e416f20e1522c867ff31527e149afb238110911e058a247bb32caa9abcc935a6: Status 404 returned error can't find the container with id e416f20e1522c867ff31527e149afb238110911e058a247bb32caa9abcc935a6
May 20 15:32:34.063364 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.063330    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:34.063534 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.063484    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:34.063615 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.063570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:35.063547777 +0000 UTC m=+3.115227230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:34.164111 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.164021    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:34.164309 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.164234    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:34.164309 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.164254    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:34.164309 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.164266    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:34.164465 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.164327    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:32:35.164309003 +0000 UTC m=+3.215988637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:34.265106 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.265066    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:34.533987 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.533939    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:27:33 +0000 UTC" deadline="2027-10-22 13:32:24.20799265 +0000 UTC"
May 20 15:32:34.533987 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.533987    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12477h59m49.674009997s"
May 20 15:32:34.543631 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.543606    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:32:34.562745 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.562714    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:34.562909 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:34.562857    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:34.586450 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.586390    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg" event={"ID":"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3","Type":"ContainerStarted","Data":"e416f20e1522c867ff31527e149afb238110911e058a247bb32caa9abcc935a6"}
May 20 15:32:34.600381 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.600331    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzc97" event={"ID":"181580ea-035f-4dec-bcae-eb826cdbd2ad","Type":"ContainerStarted","Data":"d676e2e66c84a1a715790f9826817223ea605f1664ade6b37865bfcba0d984b9"}
May 20 15:32:34.612434 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.612398    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal" event={"ID":"d8dd2018b516a9a3436de70b65c5df3e","Type":"ContainerStarted","Data":"8e8d9da30bce1dbf90632a6ea540ee986e05b2444ef7afc679961d540f958ff4"}
May 20 15:32:34.619545 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.619507    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8gtc" event={"ID":"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10","Type":"ContainerStarted","Data":"0873820401a32b78f93df4f6e644229ed1dc6b05d56a95ca9e27fe24b1fb9474"}
May 20 15:32:34.627906 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.627864    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mdr68" event={"ID":"fa286413-633d-415f-86e3-c155eb12282e","Type":"ContainerStarted","Data":"306bd5919a756bceaeddc366aec1776ab15db1fc627eb9abac8790102cdbfd0c"}
May 20 15:32:34.633741 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.633706    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pdf2" event={"ID":"240ce8a6-a8de-4400-98cb-cb44bb63e032","Type":"ContainerStarted","Data":"6217ec367d6456892244c2046f2ee193be3015760314f57953d9b3378289becc"}
May 20 15:32:34.640711 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.640671    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpk94" event={"ID":"285708ba-11b4-4be0-812b-48e038f64023","Type":"ContainerStarted","Data":"f425ccdf58f0ad73102097d58df2abaaf281296f497617f6cf2a03c86de4a9a5"}
May 20 15:32:34.653575 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.653535    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"edca11bcc6c144f7926d24be329a19ccae31b7134bb1b2ec7c30926502f30f34"}
May 20 15:32:34.676554 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.676515    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerStarted","Data":"95a34b0dca0b35e0c8e61c43df5a140d89bffd58f8eb4eaf036a16a91c045c44"}
May 20 15:32:34.690542 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.690507    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnmvl" event={"ID":"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c","Type":"ContainerStarted","Data":"5ba879e2cc906f98ca8e4028a2bcbfb673e7c9da723d201913208bc8c0dc0c63"}
May 20 15:32:34.698593 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:34.698452    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal" event={"ID":"9ef9e18c43a8b05285be032dd09ab0b2","Type":"ContainerStarted","Data":"ef48a27a1d2bdd92459bf9473376dc4583e1b2648de41fd9de771d38fc83a6e1"}
May 20 15:32:35.071443 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:35.071383    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:35.071631 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.071568    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:35.071689 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.071637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:37.071616519 +0000 UTC m=+5.123295969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:35.172742 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:35.172703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:35.172956 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.172878    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:35.172956 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.172898    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:35.172956 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.172911    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:35.173166 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.172973    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:32:37.172954417 +0000 UTC m=+5.224633873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:35.534208 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:35.534164    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:27:33 +0000 UTC" deadline="2028-02-20 06:38:26.924251378 +0000 UTC"
May 20 15:32:35.534208 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:35.534205    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15375h5m51.390050406s"
May 20 15:32:35.559843 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:35.559798    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:35.560020 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:35.559952    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:36.559996 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:36.559967    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:36.560442 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:36.560094    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:37.091358 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:37.091301    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:37.091529 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.091445    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:37.091529 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.091508    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:41.091488914 +0000 UTC m=+9.143168357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:37.192607 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:37.192455    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:37.192772 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.192614    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:37.192772 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.192633    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:37.192772 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.192646    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:37.192772 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.192708    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:32:41.192689458 +0000 UTC m=+9.244368893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:37.559905 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:37.559358    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:37.559905 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:37.559526    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:38.054388 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.053601    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mnfpx"]
May 20 15:32:38.058527 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.058074    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.058527 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.058159    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:38.097465 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.097428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-kubelet-config\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.097639 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.097483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.097639 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.097534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-dbus\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.198865 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.198813    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-dbus\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.199047 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.198914    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-kubelet-config\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.199047 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.198952    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.199164 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.199095    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:38.199164 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.199158    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:38.699139971 +0000 UTC m=+6.750819407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:38.199814 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.199783    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-dbus\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.213618 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.213354    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-kubelet-config\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.562186 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.562151    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:38.562650 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.562280    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:38.703402 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:38.703321    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:38.703582 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.703504    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:38.703582 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:38.703579    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:39.703560627 +0000 UTC m=+7.755240085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:39.560064 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:39.560028    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:39.560253 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:39.560175    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:39.560629 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:39.560605    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:39.560740 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:39.560708    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:39.711697 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:39.711656    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:39.712181 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:39.711816    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:39.712181 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:39.711897    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:41.711878423 +0000 UTC m=+9.763557880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:40.559961 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:40.559874    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:40.560146 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:40.560015    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:41.124629 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:41.124563    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:41.125117 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.124684    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:41.125117 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.124759    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:49.124739219 +0000 UTC m=+17.176418657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:41.225208 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:41.225166    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:41.225469 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.225407    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:41.225469 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.225426    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:41.225469 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.225439    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:41.225629 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.225506    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:32:49.225486407 +0000 UTC m=+17.277165867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:41.560767 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:41.560120    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:41.560767 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.560234    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:41.560767 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:41.560619    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:41.560767 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.560721    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:41.728649 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:41.728532    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:41.728816 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.728668    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:41.728816 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:41.728726    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:45.728708854 +0000 UTC m=+13.780388292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:42.560915 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:42.560878    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:42.561342 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:42.560988    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:43.559967 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:43.559903    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:43.560158 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:43.560036    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:43.560158 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:43.560100    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:43.560264 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:43.560228    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:44.559788 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:44.559755    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:44.560114 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:44.559869    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:45.559336 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:45.559301    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:45.559496 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:45.559301    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:45.559496 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:45.559429    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:45.559616 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:45.559521    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:45.760859 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:45.760805    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:45.761294 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:45.760943    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:45.761294 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:45.761009    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:53.760993208 +0000 UTC m=+21.812672662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:46.559634 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:46.559592    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:46.559817 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:46.559742    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:47.559900 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:47.559861    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:47.559900 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:47.559888    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:47.560335 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:47.559976    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:47.560335 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:47.560109    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:48.560299 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:48.560262    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:48.560718 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:48.560399    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:49.184912 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:49.184870    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:49.185127 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.185028    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:49.185127 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.185093    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:05.185075539 +0000 UTC m=+33.236754991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:49.285654 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:49.285615    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:49.285857 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.285796    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:49.285857 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.285824    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:49.285857 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.285853    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:49.286025 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.285913    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:33:05.285895703 +0000 UTC m=+33.337575139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:49.559904 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:49.559867    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:49.559904 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:49.559907    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:49.560129 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.560008    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:49.560195 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:49.560167    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:50.560452 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:50.560418    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:50.560897 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:50.560540    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:51.559919 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:51.559886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:51.560112 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:51.559886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:51.560112 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:51.560023    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:51.560211 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:51.560166    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:52.561626 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:52.561599    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:52.561996 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:52.561684    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:53.560044 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.559722    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:53.560192 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.559722    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:53.560192 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:53.560120    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:53.560274 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:53.560193    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:53.749232 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.749187    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mdr68" event={"ID":"fa286413-633d-415f-86e3-c155eb12282e","Type":"ContainerStarted","Data":"e4d2b3a25d66e01e66e8b45854b7ac0cecaaa67c5bffaef0ba33009f300c4e60"}
May 20 15:32:53.750749 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.750719    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pdf2" event={"ID":"240ce8a6-a8de-4400-98cb-cb44bb63e032","Type":"ContainerStarted","Data":"ef93edc1014fff5b06e99ab6dfa45294a99d565e5b5ff142cad9120a60f6e478"}
May 20 15:32:53.752290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.752269    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpk94" event={"ID":"285708ba-11b4-4be0-812b-48e038f64023","Type":"ContainerStarted","Data":"a57396961af7e8de7c03546f4e5173654119acecf4290451cf4d3e5993e259fd"}
May 20 15:32:53.755309 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755284    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"6b0ba8675c794c4190879ea3b4a0ed859fb59e66db86d0c880ec66b1b68e23da"}
May 20 15:32:53.755432 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755315    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"b35cd25804737cac63d5a10ecce2cb9c7c79e5350404a73014fc7b536d376c58"}
May 20 15:32:53.755432 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755326    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"25cc5558aff5d30c8bb2f876e30c11ef10c0333cccaae83ae2af39a9fca9517c"}
May 20 15:32:53.755432 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755338    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"60fb972d394f3f520c5c12e862da66d4ea06a8a090f52a13d22cd588e0444ffe"}
May 20 15:32:53.755432 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755350    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"a2c18da81028c410b048e4501c4c4ac9f412ab71776ddd098e39e2f6e07e7d66"}
May 20 15:32:53.755432 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.755362    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"cbe6206a866b3825040a60378b6f77d60c4f0efa597ad03c6ab0ddaca719a6b3"}
May 20 15:32:53.756737 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.756712    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="cff32277ca46963ea7697667a18876e16fc6c81c4b4d89790f2294882b98210d" exitCode=0
May 20 15:32:53.756868 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.756784    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"cff32277ca46963ea7697667a18876e16fc6c81c4b4d89790f2294882b98210d"}
May 20 15:32:53.758171 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.758139    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnmvl" event={"ID":"cc112da5-ca7b-43dc-9971-ebc1d7d7c14c","Type":"ContainerStarted","Data":"7a30cc359212238a97bbdd3fa82da752e9fa90aad99258d002a2c700ec08eec0"}
May 20 15:32:53.759573 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.759552    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal" event={"ID":"9ef9e18c43a8b05285be032dd09ab0b2","Type":"ContainerStarted","Data":"b6691146f2854cb3d0e27de5708d355693557bd9da7bc5362cd3b55ea168447f"}
May 20 15:32:53.761083 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.761053    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg" event={"ID":"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3","Type":"ContainerStarted","Data":"4df4a2ab5c905f6ba15624ab8d333121c2c95886d34e2bb53ec203c2211936fa"}
May 20 15:32:53.762368 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.762348    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzc97" event={"ID":"181580ea-035f-4dec-bcae-eb826cdbd2ad","Type":"ContainerStarted","Data":"e9f0ad14624cf73f6a74c076d58912dd04435ace77f3192f057d05c9e3919986"}
May 20 15:32:53.763840 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.763803    2559 generic.go:358] "Generic (PLEG): container finished" podID="d8dd2018b516a9a3436de70b65c5df3e" containerID="7b11eeba86a9b13631b63271abe0e8efe9322920869c098ee29357424a7b9469" exitCode=0
May 20 15:32:53.763932 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.763860    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal" event={"ID":"d8dd2018b516a9a3436de70b65c5df3e","Type":"ContainerDied","Data":"7b11eeba86a9b13631b63271abe0e8efe9322920869c098ee29357424a7b9469"}
May 20 15:32:53.780468 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.780414    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-mdr68" podStartSLOduration=2.997045661 podStartE2EDuration="21.780395844s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.876993855 +0000 UTC m=+1.928673305" lastFinishedPulling="2026-05-20 15:32:52.660344039 +0000 UTC m=+20.712023488" observedRunningTime="2026-05-20 15:32:53.764192632 +0000 UTC m=+21.815872112" watchObservedRunningTime="2026-05-20 15:32:53.780395844 +0000 UTC m=+21.832075306"
May 20 15:32:53.793027 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.792975    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-93.ec2.internal" podStartSLOduration=20.792959791 podStartE2EDuration="20.792959791s" podCreationTimestamp="2026-05-20 15:32:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:32:53.792556784 +0000 UTC m=+21.844236242" watchObservedRunningTime="2026-05-20 15:32:53.792959791 +0000 UTC m=+21.844639247"
May 20 15:32:53.810304 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.810246    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tzc97" podStartSLOduration=2.901989061 podStartE2EDuration="21.810226536s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.784402619 +0000 UTC m=+1.836082054" lastFinishedPulling="2026-05-20 15:32:52.692640091 +0000 UTC m=+20.744319529" observedRunningTime="2026-05-20 15:32:53.809649804 +0000 UTC m=+21.861329275" watchObservedRunningTime="2026-05-20 15:32:53.810226536 +0000 UTC m=+21.861905998"
May 20 15:32:53.821808 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.821166    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:53.822063 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:53.821855    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 15:32:53.822187 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:53.822125    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret podName:2dd5bfff-95c2-4cda-a050-e6db90ba62c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:09.822106627 +0000 UTC m=+37.873786062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret") pod "global-pull-secret-syncer-mnfpx" (UID: "2dd5bfff-95c2-4cda-a050-e6db90ba62c6") : object "kube-system"/"original-pull-secret" not registered
May 20 15:32:53.846225 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.846168    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nnmvl" podStartSLOduration=7.643131231 podStartE2EDuration="21.846149434s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.767926568 +0000 UTC m=+1.819606002" lastFinishedPulling="2026-05-20 15:32:47.970944758 +0000 UTC m=+16.022624205" observedRunningTime="2026-05-20 15:32:53.846084466 +0000 UTC m=+21.897763924" watchObservedRunningTime="2026-05-20 15:32:53.846149434 +0000 UTC m=+21.897828895"
May 20 15:32:53.858546 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.858485    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kpk94" podStartSLOduration=7.728054484 podStartE2EDuration="21.858471554s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.840608968 +0000 UTC m=+1.892288403" lastFinishedPulling="2026-05-20 15:32:47.971026034 +0000 UTC m=+16.022705473" observedRunningTime="2026-05-20 15:32:53.858088196 +0000 UTC m=+21.909767653" watchObservedRunningTime="2026-05-20 15:32:53.858471554 +0000 UTC m=+21.910151011"
May 20 15:32:53.877086 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:53.877039    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5pdf2" podStartSLOduration=3.036870191 podStartE2EDuration="21.877024692s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.851645746 +0000 UTC m=+1.903325182" lastFinishedPulling="2026-05-20 15:32:52.691800243 +0000 UTC m=+20.743479683" observedRunningTime="2026-05-20 15:32:53.876694929 +0000 UTC m=+21.928374404" watchObservedRunningTime="2026-05-20 15:32:53.877024692 +0000 UTC m=+21.928704171"
May 20 15:32:54.192282 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.192258    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 15:32:54.538574 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.538384    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T15:32:54.192277459Z","UUID":"a1640058-8d58-4e34-a904-ca8e5f5b7750","Handler":null,"Name":"","Endpoint":""}
May 20 15:32:54.540048 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.540022    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 15:32:54.540048 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.540054    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 15:32:54.562599 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.562575    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:54.562785 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:54.562712    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:54.767990 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.767903    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal" event={"ID":"d8dd2018b516a9a3436de70b65c5df3e","Type":"ContainerStarted","Data":"899c964f4c76aa5111c30148ee85b747b627a78a93d2a431c1255ec0b245a128"}
May 20 15:32:54.769531 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.769503    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8gtc" event={"ID":"4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10","Type":"ContainerStarted","Data":"9e7a1f55095c5ef6771d227fbc0a655a8ca66ebf280afdb8770577f94506cc8c"}
May 20 15:32:54.771462 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.771435    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg" event={"ID":"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3","Type":"ContainerStarted","Data":"a2b9c3fe83cf32db3294d2aff2ba23bae728f5aaa497cb3c369ed0f3a2b0b573"}
May 20 15:32:54.794288 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.794233    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-93.ec2.internal" podStartSLOduration=21.794214221 podStartE2EDuration="21.794214221s" podCreationTimestamp="2026-05-20 15:32:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:32:54.794050779 +0000 UTC m=+22.845730237" watchObservedRunningTime="2026-05-20 15:32:54.794214221 +0000 UTC m=+22.845893679"
May 20 15:32:54.817871 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:54.817803    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x8gtc" podStartSLOduration=4.053081774 podStartE2EDuration="22.817787361s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.928399721 +0000 UTC m=+1.980079172" lastFinishedPulling="2026-05-20 15:32:52.693105315 +0000 UTC m=+20.744784759" observedRunningTime="2026-05-20 15:32:54.817166969 +0000 UTC m=+22.868846418" watchObservedRunningTime="2026-05-20 15:32:54.817787361 +0000 UTC m=+22.869466817"
May 20 15:32:55.560228 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:55.560198    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:55.560410 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:55.560200    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:55.560410 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:55.560329    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:55.560531 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:55.560463    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:55.775761 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:55.775720    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"86772dfd0c3379abf7e8f10074c31f9179b21bb1cf487d4ed460018bb470a36f"}
May 20 15:32:55.777516 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:55.777488    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg" event={"ID":"cd7b4bc5-8759-4c12-8fc8-5de0a2bba3f3","Type":"ContainerStarted","Data":"df6752db6568241c4eab1338ef0bc294d84096d68a6dbf7be4a442c54ca7e2cf"}
May 20 15:32:55.797719 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:55.797369    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmfxg" podStartSLOduration=2.343077924 podStartE2EDuration="23.797349157s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.877432305 +0000 UTC m=+1.929111740" lastFinishedPulling="2026-05-20 15:32:55.33170353 +0000 UTC m=+23.383382973" observedRunningTime="2026-05-20 15:32:55.796404777 +0000 UTC m=+23.848084260" watchObservedRunningTime="2026-05-20 15:32:55.797349157 +0000 UTC m=+23.849028614"
May 20 15:32:56.563228 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:56.563200    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:56.563383 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:56.563320    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:57.559950 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:57.559913    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:57.560548 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:57.560043    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:57.560548 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:57.560109    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:57.560548 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:57.560244    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:57.686204 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:57.686159    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:57.686842 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:57.686803    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:58.559955 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.559761    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:32:58.560404 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:58.560048    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:32:58.785807 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.785772    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" event={"ID":"a6f1c997-0fca-4936-990f-7faa4e9f33cd","Type":"ContainerStarted","Data":"6056a859d6b1a283ac082e75cf089b00fd09ea8ade3b6b3d8f38449c21196974"}
May 20 15:32:58.786179 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.786140    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:58.787505 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.787482    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="be4c6da177cee3d9ad7c14b0fd0c349602441abb598ce43b188307ac982f3258" exitCode=0
May 20 15:32:58.787633 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.787520    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"be4c6da177cee3d9ad7c14b0fd0c349602441abb598ce43b188307ac982f3258"}
May 20 15:32:58.802946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.802912    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:58.823481 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:58.823398    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4" podStartSLOduration=7.813885288 podStartE2EDuration="26.823385166s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.826009881 +0000 UTC m=+1.877689319" lastFinishedPulling="2026-05-20 15:32:52.835509751 +0000 UTC m=+20.887189197" observedRunningTime="2026-05-20 15:32:58.822990777 +0000 UTC m=+26.874670236" watchObservedRunningTime="2026-05-20 15:32:58.823385166 +0000 UTC m=+26.875064622"
May 20 15:32:59.012250 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.012064    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:59.012393 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.012345    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 20 15:32:59.012675 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.012655    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kpk94"
May 20 15:32:59.559382 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.559350    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:32:59.559561 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.559357    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:32:59.559561 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:59.559462    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:32:59.559665 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:32:59.559603    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:32:59.789458 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.789436    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:59.789843 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.789481    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:32:59.803894 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:32:59.803868    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:33:00.095035 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.094943    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnfpx"]
May 20 15:33:00.095185 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.095066    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:00.095247 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:00.095185    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:33:00.095693 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.095668    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6ddl"]
May 20 15:33:00.095850 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.095779    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:00.095912 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:00.095897    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:33:00.096323 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.096288    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lflkp"]
May 20 15:33:00.096413 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.096390    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:00.096513 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:00.096495    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:33:00.792338 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.792304    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="fa01a01ceac4dc1e59114f366df2c6d5c677af21471709e81c4241a303e0dea8" exitCode=0
May 20 15:33:00.792889 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:00.792368    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"fa01a01ceac4dc1e59114f366df2c6d5c677af21471709e81c4241a303e0dea8"}
May 20 15:33:01.559729 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:01.559702    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:01.559859 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:01.559734    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:01.559859 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:01.559705    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:01.559859 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:01.559802    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:33:01.559961 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:01.559885    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:33:01.559961 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:01.559944    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:33:01.796665 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:01.796634    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="6e51d00498850a6056ec11d49a37e659affdabc7d714201835403f36d4877653" exitCode=0
May 20 15:33:01.797213 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:01.796701    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"6e51d00498850a6056ec11d49a37e659affdabc7d714201835403f36d4877653"}
May 20 15:33:03.560100 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:03.559919    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:03.560650 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:03.559931    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:03.560650 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:03.560185    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:33:03.560650 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:03.560283    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:33:03.560650 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:03.559931    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:03.560650 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:03.560399    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:33:05.206715 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.206682    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:05.207188 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.206822    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:33:05.207188 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.206901    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:37.206885787 +0000 UTC m=+65.258565222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:33:05.307326 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.307294    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:05.307496 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.307468    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:33:05.307496 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.307493    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:33:05.307605 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.307506    2559 projected.go:194] Error preparing data for projected volume kube-api-access-jkc8m for pod openshift-network-diagnostics/network-check-target-l6ddl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:33:05.307605 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.307578    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m podName:8298e4e3-e553-4cea-a6f1-1a50004f409e nodeName:}" failed. No retries permitted until 2026-05-20 15:33:37.307557018 +0000 UTC m=+65.359236476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkc8m" (UniqueName: "kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m") pod "network-check-target-l6ddl" (UID: "8298e4e3-e553-4cea-a6f1-1a50004f409e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:33:05.560267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.560228    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:05.560267 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.560255    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:05.560510 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.560349    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:05.560510 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.560366    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:33:05.560510 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.560446    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6ddl" podUID="8298e4e3-e553-4cea-a6f1-1a50004f409e"
May 20 15:33:05.560669 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:05.560531    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnfpx" podUID="2dd5bfff-95c2-4cda-a050-e6db90ba62c6"
May 20 15:33:05.773640 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.773613    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-93.ec2.internal" event="NodeReady"
May 20 15:33:05.773803 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.773788    2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 15:33:05.812674 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.812640    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:33:05.894946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.894904    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:33:05.894946 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.894942    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dp8ml"]
May 20 15:33:05.898661 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.895931    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:05.899916 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.899824    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 15:33:05.899916 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.899811    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 15:33:05.900149 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.899977    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 15:33:05.900149 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.900089    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2gccf\""
May 20 15:33:05.905204 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.905182    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 15:33:05.914949 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.914920    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nfv2f"]
May 20 15:33:05.915064 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.915053    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:05.917820 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.917797    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 15:33:05.918202 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.918179    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6j2b\""
May 20 15:33:05.918290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.918267    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 15:33:05.928901 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.928876    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dp8ml"]
May 20 15:33:05.928901 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.928901    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nfv2f"]
May 20 15:33:05.929055 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.929003    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:05.933353 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.933333    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 15:33:05.933634 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.933614    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 15:33:05.933822 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.933809    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94zvt\""
May 20 15:33:05.934178 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:05.934157    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 15:33:06.014605 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.014797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428vq\" (UniqueName: \"kubernetes.io/projected/54a52853-c484-4669-b435-6a08ebedd3de-kube-api-access-428vq\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.014797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.014797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.014797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79npc\" (UniqueName: \"kubernetes.io/projected/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-kube-api-access-79npc\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.014797 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-tmp-dir\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-config-volume\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.014972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.015092 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.015052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.015331 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.015135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.015331 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.015190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xjz\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.115553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115474    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-428vq\" (UniqueName: \"kubernetes.io/projected/54a52853-c484-4669-b435-6a08ebedd3de-kube-api-access-428vq\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.115553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115507    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.115553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115524    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.115752 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115641    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79npc\" (UniqueName: \"kubernetes.io/projected/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-kube-api-access-79npc\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.115752 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115724    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-tmp-dir\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.115823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115760    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-config-volume\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.115823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115783    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.115823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.115807    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116013 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.115860    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:06.116013 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.115882    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:06.116013 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.115956    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:06.615932797 +0000 UTC m=+34.667612255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:06.116185 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116083    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.116185 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-tmp-dir\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.116185 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116121    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116185 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116172    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.116203    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116230    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.116268    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:06.616250432 +0000 UTC m=+34.667929874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.116298    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.116348    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:06.616333043 +0000 UTC m=+34.668012491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:06.116386 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116373    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xjz\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116644 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116420    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116644 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116422    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116644 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-config-volume\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.116644 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116373    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.116768 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.116674    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.120098 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.120073    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.120098 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.120086    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.131769 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.131745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.132002 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.131983    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-428vq\" (UniqueName: \"kubernetes.io/projected/54a52853-c484-4669-b435-6a08ebedd3de-kube-api-access-428vq\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.132044 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.132017    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xjz\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.132095 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.132080    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79npc\" (UniqueName: \"kubernetes.io/projected/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-kube-api-access-79npc\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.620008 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.619967    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.620048    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620148    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620176    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620190    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:06.620151    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620238    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:07.620218694 +0000 UTC m=+35.671898166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620240    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620279    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:07.620254236 +0000 UTC m=+35.671933684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:06.620492 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:06.620306    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:07.620295772 +0000 UTC m=+35.671975211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:07.559384 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.559347    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:07.559581 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.559351    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:07.559581 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.559351    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:07.563528 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.563507    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 15:33:07.563657 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.563543    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 15:33:07.563880 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.563859    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qfs\""
May 20 15:33:07.564008 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.563992    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 15:33:07.564344 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.564171    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xw7hl\""
May 20 15:33:07.564420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.564360    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 15:33:07.628111 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.628069    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.628138    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:07.628196    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628230    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628255    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628293    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:09.628276502 +0000 UTC m=+37.679955954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628337    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:09.628318683 +0000 UTC m=+37.679998135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628369    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628391    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:07.628573 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:07.628454    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:09.628438341 +0000 UTC m=+37.680117795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:08.814555 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:08.814320    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerStarted","Data":"0da0ed6414372b3aad2fe77306eaf407b234e199d55296c004e41dc87f208957"}
May 20 15:33:09.645283 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.645238    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:09.645433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.645303    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:09.645433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.645351    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:09.645433 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645417    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645451    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645482    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645497    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645500    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:13.645479439 +0000 UTC m=+41.697158890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645516    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:13.645507986 +0000 UTC m=+41.697187428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:09.645599 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:09.645548    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:13.645530746 +0000 UTC m=+41.697210183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:09.818809 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.818764    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="0da0ed6414372b3aad2fe77306eaf407b234e199d55296c004e41dc87f208957" exitCode=0
May 20 15:33:09.818809 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.818808    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"0da0ed6414372b3aad2fe77306eaf407b234e199d55296c004e41dc87f208957"}
May 20 15:33:09.847123 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.847086    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:09.850622 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.850601    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dd5bfff-95c2-4cda-a050-e6db90ba62c6-original-pull-secret\") pod \"global-pull-secret-syncer-mnfpx\" (UID: \"2dd5bfff-95c2-4cda-a050-e6db90ba62c6\") " pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:09.981248 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:09.981221    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnfpx"
May 20 15:33:10.171032 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:10.170955    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnfpx"]
May 20 15:33:10.174931 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:33:10.174903    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd5bfff_95c2_4cda_a050_e6db90ba62c6.slice/crio-de2e9d1bd3629c6ac3127ca05893d2eaa8f0f0b18e202f0b419bb94e0f9dbe49 WatchSource:0}: Error finding container de2e9d1bd3629c6ac3127ca05893d2eaa8f0f0b18e202f0b419bb94e0f9dbe49: Status 404 returned error can't find the container with id de2e9d1bd3629c6ac3127ca05893d2eaa8f0f0b18e202f0b419bb94e0f9dbe49
May 20 15:33:10.822818 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:10.822784    2559 generic.go:358] "Generic (PLEG): container finished" podID="abb53c6b-e8a4-4542-ba66-9bed7765c0f1" containerID="06e6b64d55d86e2b35983c3df17b938255bdf566a015f1f35b286de76f15653f" exitCode=0
May 20 15:33:10.823550 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:10.822862    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerDied","Data":"06e6b64d55d86e2b35983c3df17b938255bdf566a015f1f35b286de76f15653f"}
May 20 15:33:10.824300 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:10.823930    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnfpx" event={"ID":"2dd5bfff-95c2-4cda-a050-e6db90ba62c6","Type":"ContainerStarted","Data":"de2e9d1bd3629c6ac3127ca05893d2eaa8f0f0b18e202f0b419bb94e0f9dbe49"}
May 20 15:33:11.830013 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:11.829733    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" event={"ID":"abb53c6b-e8a4-4542-ba66-9bed7765c0f1","Type":"ContainerStarted","Data":"01b09c3b9ea0f7c61a64010385eb98e279360fd9489e45d71a8755d8cb419a16"}
May 20 15:33:11.862189 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:11.862137    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sgjpt" podStartSLOduration=5.097559957 podStartE2EDuration="39.862122535s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:32:33.805095289 +0000 UTC m=+1.856774723" lastFinishedPulling="2026-05-20 15:33:08.569657855 +0000 UTC m=+36.621337301" observedRunningTime="2026-05-20 15:33:11.860440212 +0000 UTC m=+39.912119669" watchObservedRunningTime="2026-05-20 15:33:11.862122535 +0000 UTC m=+39.913802019"
May 20 15:33:13.675233 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:13.675190    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:13.675265    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675354    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675415    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675431    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:21.675413657 +0000 UTC m=+49.727093113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675437    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675445    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:13.675358    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675495    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:21.675476332 +0000 UTC m=+49.727155787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:13.675693 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:13.675520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:21.675513537 +0000 UTC m=+49.727192972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:15.839378 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:15.839343    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnfpx" event={"ID":"2dd5bfff-95c2-4cda-a050-e6db90ba62c6","Type":"ContainerStarted","Data":"5a6ef746fa302a381773ce29ecf76a2ba1110f98b8c6d616a7855306e8dca353"}
May 20 15:33:15.862576 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:15.862528    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mnfpx" podStartSLOduration=32.989858 podStartE2EDuration="37.862514874s" podCreationTimestamp="2026-05-20 15:32:38 +0000 UTC" firstStartedPulling="2026-05-20 15:33:10.17667431 +0000 UTC m=+38.228353745" lastFinishedPulling="2026-05-20 15:33:15.049331171 +0000 UTC m=+43.101010619" observedRunningTime="2026-05-20 15:33:15.861779018 +0000 UTC m=+43.913458475" watchObservedRunningTime="2026-05-20 15:33:15.862514874 +0000 UTC m=+43.914194310"
May 20 15:33:21.737180 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:21.737135    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:21.737200    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:21.737254    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737288    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737351    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:33:37.737335316 +0000 UTC m=+65.789014751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737357    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737369    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737384    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737407    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:37.737391922 +0000 UTC m=+65.789071375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:21.737602 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:21.737425    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:37.737415814 +0000 UTC m=+65.789095250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:22.917709 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.917677    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"]
May 20 15:33:22.932206 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.932178    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:22.935820 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.935785    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"]
May 20 15:33:22.936062 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.936040    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 15:33:22.936284 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.936077    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 20 15:33:22.936395 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.936082    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 15:33:22.936395 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.936120    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 15:33:22.936395 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:22.936176    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hvdqj\""
May 20 15:33:23.046990 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.046950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d633a685-9c75-42cf-9f9a-56f98e9d15f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.047168 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.046997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8nj5\" (UniqueName: \"kubernetes.io/projected/d633a685-9c75-42cf-9f9a-56f98e9d15f7-kube-api-access-f8nj5\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.148308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.148276    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d633a685-9c75-42cf-9f9a-56f98e9d15f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.148488 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.148317    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8nj5\" (UniqueName: \"kubernetes.io/projected/d633a685-9c75-42cf-9f9a-56f98e9d15f7-kube-api-access-f8nj5\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.152033 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.152002    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d633a685-9c75-42cf-9f9a-56f98e9d15f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.156779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.156752    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8nj5\" (UniqueName: \"kubernetes.io/projected/d633a685-9c75-42cf-9f9a-56f98e9d15f7-kube-api-access-f8nj5\") pod \"managed-serviceaccount-addon-agent-9549c895d-pc8dr\" (UID: \"d633a685-9c75-42cf-9f9a-56f98e9d15f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.256262 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.256144    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"
May 20 15:33:23.393166 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.393134    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr"]
May 20 15:33:23.396498 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:33:23.396475    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd633a685_9c75_42cf_9f9a_56f98e9d15f7.slice/crio-3172f1d709ddd6fcc18007f81f70abd241e2018ba0c49b4da580caa27c763ff2 WatchSource:0}: Error finding container 3172f1d709ddd6fcc18007f81f70abd241e2018ba0c49b4da580caa27c763ff2: Status 404 returned error can't find the container with id 3172f1d709ddd6fcc18007f81f70abd241e2018ba0c49b4da580caa27c763ff2
May 20 15:33:23.855864 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:23.855813    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr" event={"ID":"d633a685-9c75-42cf-9f9a-56f98e9d15f7","Type":"ContainerStarted","Data":"3172f1d709ddd6fcc18007f81f70abd241e2018ba0c49b4da580caa27c763ff2"}
May 20 15:33:26.863466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:26.863428    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr" event={"ID":"d633a685-9c75-42cf-9f9a-56f98e9d15f7","Type":"ContainerStarted","Data":"d388339a0fcac806f4c56cceb190a1cb1b89cb7aff046dec035815774fb07a0b"}
May 20 15:33:26.889320 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:26.889270    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr" podStartSLOduration=1.804850699 podStartE2EDuration="4.88925453s" podCreationTimestamp="2026-05-20 15:33:22 +0000 UTC" firstStartedPulling="2026-05-20 15:33:23.398869231 +0000 UTC m=+51.450548680" lastFinishedPulling="2026-05-20 15:33:26.483273073 +0000 UTC m=+54.534952511" observedRunningTime="2026-05-20 15:33:26.887697164 +0000 UTC m=+54.939376621" watchObservedRunningTime="2026-05-20 15:33:26.88925453 +0000 UTC m=+54.940934110"
May 20 15:33:31.807929 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:31.807898    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmwf4"
May 20 15:33:37.255318 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.255278    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:33:37.258433 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.258412    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 15:33:37.266096 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.266070    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 15:33:37.266147 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.266137    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:41.266119655 +0000 UTC m=+129.317799089 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : secret "metrics-daemon-secret" not found
May 20 15:33:37.356290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.356255    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:37.359403 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.359384    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 15:33:37.370007 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.369983    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 15:33:37.379854 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.379806    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkc8m\" (UniqueName: \"kubernetes.io/projected/8298e4e3-e553-4cea-a6f1-1a50004f409e-kube-api-access-jkc8m\") pod \"network-check-target-l6ddl\" (UID: \"8298e4e3-e553-4cea-a6f1-1a50004f409e\") " pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:37.576764 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.576737    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xw7hl\""
May 20 15:33:37.584064 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.584042    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:37.712031 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.712000    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6ddl"]
May 20 15:33:37.715595 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:33:37.715565    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8298e4e3_e553_4cea_a6f1_1a50004f409e.slice/crio-a255ce2c8ae19e3d185d5a3327b5899977e30c268d6de6eecb15a03ec1fa98d5 WatchSource:0}: Error finding container a255ce2c8ae19e3d185d5a3327b5899977e30c268d6de6eecb15a03ec1fa98d5: Status 404 returned error can't find the container with id a255ce2c8ae19e3d185d5a3327b5899977e30c268d6de6eecb15a03ec1fa98d5
May 20 15:33:37.760175 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.760128    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:33:37.760175 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.760176    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:33:37.760371 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760265    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:37.760371 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760269    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:37.760371 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.760323    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:33:37.760371 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760338    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:09.760318345 +0000 UTC m=+97.811997798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:33:37.760371 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760359    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:34:09.760349667 +0000 UTC m=+97.812029106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:33:37.760532 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760397    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:33:37.760532 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760410    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:33:37.760532 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:33:37.760450    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:09.76043882 +0000 UTC m=+97.812118268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:33:37.885919 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:37.885819    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6ddl" event={"ID":"8298e4e3-e553-4cea-a6f1-1a50004f409e","Type":"ContainerStarted","Data":"a255ce2c8ae19e3d185d5a3327b5899977e30c268d6de6eecb15a03ec1fa98d5"}
May 20 15:33:40.894018 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:40.893923    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6ddl" event={"ID":"8298e4e3-e553-4cea-a6f1-1a50004f409e","Type":"ContainerStarted","Data":"5b74f147fa446351aa14a22b7ab8d86e850f227b4fe4332c20209703bf23cf8d"}
May 20 15:33:40.894378 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:40.894038    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:33:40.912386 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:33:40.912333    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l6ddl" podStartSLOduration=66.026023186 podStartE2EDuration="1m8.912316887s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:33:37.717351734 +0000 UTC m=+65.769031171" lastFinishedPulling="2026-05-20 15:33:40.603645426 +0000 UTC m=+68.655324872" observedRunningTime="2026-05-20 15:33:40.911212678 +0000 UTC m=+68.962892136" watchObservedRunningTime="2026-05-20 15:33:40.912316887 +0000 UTC m=+68.963996343"
May 20 15:34:09.793073 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:09.793031    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:34:09.793073 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:09.793073    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:09.793108    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793199    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793202    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793277    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert podName:54a52853-c484-4669-b435-6a08ebedd3de nodeName:}" failed. No retries permitted until 2026-05-20 15:35:13.793257759 +0000 UTC m=+161.844937194 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert") pod "ingress-canary-nfv2f" (UID: "54a52853-c484-4669-b435-6a08ebedd3de") : secret "canary-serving-cert" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793204    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793211    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8fd4cc45-xjtpr: secret "image-registry-tls" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793391    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls podName:3bc2640c-ca66-4ec8-89f5-a89ffb6ece64 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:13.793376351 +0000 UTC m=+161.845055786 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls") pod "dns-default-dp8ml" (UID: "3bc2640c-ca66-4ec8-89f5-a89ffb6ece64") : secret "dns-default-metrics-tls" not found
May 20 15:34:09.793547 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:09.793431    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls podName:35a49505-01a8-4e66-b7fc-49f464354bd3 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:13.793413476 +0000 UTC m=+161.845092925 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls") pod "image-registry-b8fd4cc45-xjtpr" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3") : secret "image-registry-tls" not found
May 20 15:34:11.898090 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:11.898053    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l6ddl"
May 20 15:34:41.320560 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:41.320516    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:34:41.321076 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:41.320681    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 15:34:41.321076 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:41.320753    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs podName:b633256f-cf71-47cc-8224-0bb5a10ff4c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:36:43.320736378 +0000 UTC m=+251.372415813 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs") pod "network-metrics-daemon-lflkp" (UID: "b633256f-cf71-47cc-8224-0bb5a10ff4c6") : secret "metrics-daemon-secret" not found
May 20 15:34:52.607554 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.607513    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-h24kw"]
May 20 15:34:52.610292 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.610270    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.612702 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.612677    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 20 15:34:52.612901 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.612881    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 15:34:52.613063 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.613052    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 15:34:52.614051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.614017    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 20 15:34:52.615241 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.615220    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5j5ps\""
May 20 15:34:52.619613 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.619594    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 20 15:34:52.623428 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.623409    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-h24kw"]
May 20 15:34:52.750254 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.750218    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"]
May 20 15:34:52.752891 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.752875    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:52.758158 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.758121    2559 status_manager.go:895] "Failed to get status for pod" podUID="28970993-18f8-4680-8202-a7790234294b" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m" err="pods \"cluster-samples-operator-697587599-flp4m\" is forbidden: User \"system:node:ip-10-0-135-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-135-93.ec2.internal' and this object"
May 20 15:34:52.758305 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:52.758158    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"samples-operator-tls\" is forbidden: User \"system:node:ip-10-0-135-93.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-135-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret"
May 20 15:34:52.758305 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:52.758203    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-93.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-135-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
May 20 15:34:52.758305 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:52.758169    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-93.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-135-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
May 20 15:34:52.758305 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:52.758163    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-samples-operator-dockercfg-m9vkt\" is forbidden: User \"system:node:ip-10-0-135-93.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-135-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m9vkt\"" type="*v1.Secret"
May 20 15:34:52.779310 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.779281    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"]
May 20 15:34:52.803137 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcd9\" (UniqueName: \"kubernetes.io/projected/30b189fc-aada-4e0f-a585-e598e637bc92-kube-api-access-mkcd9\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.803290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-snapshots\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.803290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-tmp\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.803290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.803290 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.803446 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.803330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30b189fc-aada-4e0f-a585-e598e637bc92-serving-cert\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.818815 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.818781    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"]
May 20 15:34:52.821382 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.821366    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"]
May 20 15:34:52.821528 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.821511    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:52.824369 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.824349    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 15:34:52.824369 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.824356    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:52.824604 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.824586    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 15:34:52.824681 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.824607    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vrcm8\""
May 20 15:34:52.825017 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.825001    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 15:34:52.825131 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.825113    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 15:34:52.826656 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.826642    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-msgr9\""
May 20 15:34:52.826766 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.826751    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 15:34:52.827424 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.827407    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 15:34:52.827520 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.827503    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 15:34:52.827663 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.827649    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 15:34:52.837436 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.837413    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"]
May 20 15:34:52.840462 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.840439    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"]
May 20 15:34:52.904218 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904132    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-snapshots\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904218 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904167    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-tmp\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904218 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904191    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904218 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904207    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904226    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30b189fc-aada-4e0f-a585-e598e637bc92-serving-cert\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:52.904595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904447    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcd9\" (UniqueName: \"kubernetes.io/projected/30b189fc-aada-4e0f-a585-e598e637bc92-kube-api-access-mkcd9\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.904595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.904496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9l2\" (UniqueName: \"kubernetes.io/projected/28970993-18f8-4680-8202-a7790234294b-kube-api-access-md9l2\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:52.905083 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.905059    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-tmp\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.905192 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.905059    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30b189fc-aada-4e0f-a585-e598e637bc92-snapshots\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.905565 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.905538    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-service-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.905721 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.905694    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b189fc-aada-4e0f-a585-e598e637bc92-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.907588 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.907560    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30b189fc-aada-4e0f-a585-e598e637bc92-serving-cert\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.916448 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.916420    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcd9\" (UniqueName: \"kubernetes.io/projected/30b189fc-aada-4e0f-a585-e598e637bc92-kube-api-access-mkcd9\") pod \"insights-operator-78bdfb888c-h24kw\" (UID: \"30b189fc-aada-4e0f-a585-e598e637bc92\") " pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:52.919099 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:52.919071    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-h24kw"
May 20 15:34:53.005306 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htshz\" (UniqueName: \"kubernetes.io/projected/7d3b96de-681f-41be-8245-a913e6bfcc42-kube-api-access-htshz\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.005306 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5291f3b7-8eb5-4b39-8259-3713c171cb95-config\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.005534 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxzn\" (UniqueName: \"kubernetes.io/projected/5291f3b7-8eb5-4b39-8259-3713c171cb95-kube-api-access-llxzn\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.005534 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.005648 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d3b96de-681f-41be-8245-a913e6bfcc42-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.005648 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5291f3b7-8eb5-4b39-8259-3713c171cb95-serving-cert\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.005648 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005642    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md9l2\" (UniqueName: \"kubernetes.io/projected/28970993-18f8-4680-8202-a7790234294b-kube-api-access-md9l2\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:53.005786 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.005759    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:53.053370 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.053338    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-h24kw"]
May 20 15:34:53.057026 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:34:53.056990    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b189fc_aada_4e0f_a585_e598e637bc92.slice/crio-8e6fc0edeae8edc2bb3c5458d3c9fa5ab4a15da649c48fc5c95dbdd97294a64d WatchSource:0}: Error finding container 8e6fc0edeae8edc2bb3c5458d3c9fa5ab4a15da649c48fc5c95dbdd97294a64d: Status 404 returned error can't find the container with id 8e6fc0edeae8edc2bb3c5458d3c9fa5ab4a15da649c48fc5c95dbdd97294a64d
May 20 15:34:53.106406 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106357    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htshz\" (UniqueName: \"kubernetes.io/projected/7d3b96de-681f-41be-8245-a913e6bfcc42-kube-api-access-htshz\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.106406 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106404    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5291f3b7-8eb5-4b39-8259-3713c171cb95-config\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.106619 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106427    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llxzn\" (UniqueName: \"kubernetes.io/projected/5291f3b7-8eb5-4b39-8259-3713c171cb95-kube-api-access-llxzn\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.106619 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106535    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.106619 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106588    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d3b96de-681f-41be-8245-a913e6bfcc42-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.106765 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.106619    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5291f3b7-8eb5-4b39-8259-3713c171cb95-serving-cert\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.106765 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:53.106746    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:34:53.106874 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:53.106820    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:53.606799059 +0000 UTC m=+141.658478511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:34:53.107260 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.107240    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d3b96de-681f-41be-8245-a913e6bfcc42-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.107505 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.107482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5291f3b7-8eb5-4b39-8259-3713c171cb95-config\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.108914 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.108889    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5291f3b7-8eb5-4b39-8259-3713c171cb95-serving-cert\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.118170 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.118149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxzn\" (UniqueName: \"kubernetes.io/projected/5291f3b7-8eb5-4b39-8259-3713c171cb95-kube-api-access-llxzn\") pod \"service-ca-operator-57b5b68b8-8n7ct\" (UID: \"5291f3b7-8eb5-4b39-8259-3713c171cb95\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.118534 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.118518    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htshz\" (UniqueName: \"kubernetes.io/projected/7d3b96de-681f-41be-8245-a913e6bfcc42-kube-api-access-htshz\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.137102 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.137084    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"
May 20 15:34:53.261782 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.261751    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct"]
May 20 15:34:53.264684 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:34:53.264658    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5291f3b7_8eb5_4b39_8259_3713c171cb95.slice/crio-9f46be8b5a4e26b1f6099ba36e5a60bbbe17a2de87f3c91e4bd9e0aedcf67c1b WatchSource:0}: Error finding container 9f46be8b5a4e26b1f6099ba36e5a60bbbe17a2de87f3c91e4bd9e0aedcf67c1b: Status 404 returned error can't find the container with id 9f46be8b5a4e26b1f6099ba36e5a60bbbe17a2de87f3c91e4bd9e0aedcf67c1b
May 20 15:34:53.610983 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.610931    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:53.611368 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:53.611091    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:34:53.611368 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:53.611157    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.611141275 +0000 UTC m=+142.662820710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:34:53.692849 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.692802    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m9vkt\""
May 20 15:34:53.772666 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.772632    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 20 15:34:53.816951 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.816920    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 20 15:34:53.826764 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:53.826738    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9l2\" (UniqueName: \"kubernetes.io/projected/28970993-18f8-4680-8202-a7790234294b-kube-api-access-md9l2\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:54.006160 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.006082    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: failed to sync secret cache: timed out waiting for the condition
May 20 15:34:54.006318 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.006183    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls podName:28970993-18f8-4680-8202-a7790234294b nodeName:}" failed. No retries permitted until 2026-05-20 15:34:54.506160372 +0000 UTC m=+142.557839810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls") pod "cluster-samples-operator-697587599-flp4m" (UID: "28970993-18f8-4680-8202-a7790234294b") : failed to sync secret cache: timed out waiting for the condition
May 20 15:34:54.033784 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:54.033749    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-h24kw" event={"ID":"30b189fc-aada-4e0f-a585-e598e637bc92","Type":"ContainerStarted","Data":"8e6fc0edeae8edc2bb3c5458d3c9fa5ab4a15da649c48fc5c95dbdd97294a64d"}
May 20 15:34:54.034922 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:54.034890    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct" event={"ID":"5291f3b7-8eb5-4b39-8259-3713c171cb95","Type":"ContainerStarted","Data":"9f46be8b5a4e26b1f6099ba36e5a60bbbe17a2de87f3c91e4bd9e0aedcf67c1b"}
May 20 15:34:54.093134 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:54.093095    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 20 15:34:54.518943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:54.518895    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:54.519145 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.519087    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 15:34:54.519214 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.519164    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls podName:28970993-18f8-4680-8202-a7790234294b nodeName:}" failed. No retries permitted until 2026-05-20 15:34:55.519142279 +0000 UTC m=+143.570821722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls") pod "cluster-samples-operator-697587599-flp4m" (UID: "28970993-18f8-4680-8202-a7790234294b") : secret "samples-operator-tls" not found
May 20 15:34:54.619516 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:54.619479    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:54.619972 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.619627    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:34:54.619972 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:54.619704    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:56.619680434 +0000 UTC m=+144.671359872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:34:55.525675 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:55.525625    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:55.525881 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:55.525799    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 15:34:55.525955 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:55.525895    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls podName:28970993-18f8-4680-8202-a7790234294b nodeName:}" failed. No retries permitted until 2026-05-20 15:34:57.525874211 +0000 UTC m=+145.577553654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls") pod "cluster-samples-operator-697587599-flp4m" (UID: "28970993-18f8-4680-8202-a7790234294b") : secret "samples-operator-tls" not found
May 20 15:34:56.040303 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:56.040266    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-h24kw" event={"ID":"30b189fc-aada-4e0f-a585-e598e637bc92","Type":"ContainerStarted","Data":"2cb110a3366ba79dc918a196e414b49e97f982401f722e693f93089d96a9c69e"}
May 20 15:34:56.041662 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:56.041634    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct" event={"ID":"5291f3b7-8eb5-4b39-8259-3713c171cb95","Type":"ContainerStarted","Data":"9721717d26217add677890fd9c858c0cdd0a86fc6e5318c1404f1ff0e58dee89"}
May 20 15:34:56.069238 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:56.069185    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-h24kw" podStartSLOduration=1.441085858 podStartE2EDuration="4.069170198s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:34:53.059106398 +0000 UTC m=+141.110785834" lastFinishedPulling="2026-05-20 15:34:55.687190726 +0000 UTC m=+143.738870174" observedRunningTime="2026-05-20 15:34:56.068728479 +0000 UTC m=+144.120407937" watchObservedRunningTime="2026-05-20 15:34:56.069170198 +0000 UTC m=+144.120849654"
May 20 15:34:56.100054 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:56.099994    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct" podStartSLOduration=1.6801798510000001 podStartE2EDuration="4.099972929s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:34:53.266492227 +0000 UTC m=+141.318171663" lastFinishedPulling="2026-05-20 15:34:55.686285292 +0000 UTC m=+143.737964741" observedRunningTime="2026-05-20 15:34:56.099311799 +0000 UTC m=+144.150991258" watchObservedRunningTime="2026-05-20 15:34:56.099972929 +0000 UTC m=+144.151652388"
May 20 15:34:56.635228 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:56.635188    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:34:56.635399 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:56.635360    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:34:56.635460 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:56.635449    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:00.635426195 +0000 UTC m=+148.687105636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:34:57.541885 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:57.541823    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:34:57.542286 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:57.541966    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 15:34:57.542286 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:34:57.542045    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls podName:28970993-18f8-4680-8202-a7790234294b nodeName:}" failed. No retries permitted until 2026-05-20 15:35:01.5420234 +0000 UTC m=+149.593702835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls") pod "cluster-samples-operator-697587599-flp4m" (UID: "28970993-18f8-4680-8202-a7790234294b") : secret "samples-operator-tls" not found
May 20 15:34:59.442313 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:34:59.442286    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mdr68_fa286413-633d-415f-86e3-c155eb12282e/dns-node-resolver/0.log"
May 20 15:35:00.643036 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:00.643010    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnmvl_cc112da5-ca7b-43dc-9971-ebc1d7d7c14c/node-ca/0.log"
May 20 15:35:00.668554 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:00.668520    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:35:00.668739 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:00.668654    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:35:00.668739 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:00.668713    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:08.668698404 +0000 UTC m=+156.720377838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:35:01.576729 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:01.576687    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:35:01.576938 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:01.576857    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 15:35:01.576938 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:01.576927    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls podName:28970993-18f8-4680-8202-a7790234294b nodeName:}" failed. No retries permitted until 2026-05-20 15:35:09.57691066 +0000 UTC m=+157.628590100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls") pod "cluster-samples-operator-697587599-flp4m" (UID: "28970993-18f8-4680-8202-a7790234294b") : secret "samples-operator-tls" not found
May 20 15:35:08.734430 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:08.734386    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:35:08.734874 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:08.734517    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 15:35:08.734874 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:08.734583    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls podName:7d3b96de-681f-41be-8245-a913e6bfcc42 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:24.734568538 +0000 UTC m=+172.786247973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vt6qc" (UID: "7d3b96de-681f-41be-8245-a913e6bfcc42") : secret "cluster-monitoring-operator-tls" not found
May 20 15:35:08.910206 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:08.910144    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3"
May 20 15:35:08.924553 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:08.924525    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dp8ml" podUID="3bc2640c-ca66-4ec8-89f5-a89ffb6ece64"
May 20 15:35:08.938868 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:08.938818    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nfv2f" podUID="54a52853-c484-4669-b435-6a08ebedd3de"
May 20 15:35:09.067690 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:09.067664    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:09.641127 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:09.641096    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:35:09.643589 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:09.643559    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28970993-18f8-4680-8202-a7790234294b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-flp4m\" (UID: \"28970993-18f8-4680-8202-a7790234294b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:35:09.861044 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:09.861002    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"
May 20 15:35:09.994062 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:09.994021    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m"]
May 20 15:35:10.070556 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:10.070522    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m" event={"ID":"28970993-18f8-4680-8202-a7790234294b","Type":"ContainerStarted","Data":"1cb9b13551791b1f8d565bb9b59b0ef81cdda3f8d28ce93ffa1eeb616b9c09be"}
May 20 15:35:10.586149 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:10.586099    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lflkp" podUID="b633256f-cf71-47cc-8224-0bb5a10ff4c6"
May 20 15:35:12.077071 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:12.077032    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m" event={"ID":"28970993-18f8-4680-8202-a7790234294b","Type":"ContainerStarted","Data":"6ee5af7b8d226765084593d5fb6e95b9d3d918c5a01477e566ea2d24569c9842"}
May 20 15:35:12.077071 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:12.077069    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m" event={"ID":"28970993-18f8-4680-8202-a7790234294b","Type":"ContainerStarted","Data":"3f83f920664e7cf9939a626565c1d0884de944165c0e357f5b0832a53df886c7"}
May 20 15:35:12.095147 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:12.095095    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-flp4m" podStartSLOduration=18.634428707 podStartE2EDuration="20.095079195s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:35:10.038720814 +0000 UTC m=+158.090400252" lastFinishedPulling="2026-05-20 15:35:11.499371306 +0000 UTC m=+159.551050740" observedRunningTime="2026-05-20 15:35:12.094106044 +0000 UTC m=+160.145785492" watchObservedRunningTime="2026-05-20 15:35:12.095079195 +0000 UTC m=+160.146758652"
May 20 15:35:13.876059 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.876017    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:13.876463 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.876073    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:13.876463 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.876103    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:35:13.878796 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.878621    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc2640c-ca66-4ec8-89f5-a89ffb6ece64-metrics-tls\") pod \"dns-default-dp8ml\" (UID: \"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64\") " pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:13.878796 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.878655    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54a52853-c484-4669-b435-6a08ebedd3de-cert\") pod \"ingress-canary-nfv2f\" (UID: \"54a52853-c484-4669-b435-6a08ebedd3de\") " pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:35:13.878796 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:13.878753    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"image-registry-b8fd4cc45-xjtpr\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") " pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:14.171285 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:14.171203    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6j2b\""
May 20 15:35:14.179474 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:14.179441    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:14.305811 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:14.305778    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dp8ml"]
May 20 15:35:14.308685 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:14.308651    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc2640c_ca66_4ec8_89f5_a89ffb6ece64.slice/crio-cc735e8fb89ea5a38aa3d3d6f07044cee264926c603b767d0b13795ddafa9ea4 WatchSource:0}: Error finding container cc735e8fb89ea5a38aa3d3d6f07044cee264926c603b767d0b13795ddafa9ea4: Status 404 returned error can't find the container with id cc735e8fb89ea5a38aa3d3d6f07044cee264926c603b767d0b13795ddafa9ea4
May 20 15:35:15.085587 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:15.085550    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dp8ml" event={"ID":"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64","Type":"ContainerStarted","Data":"cc735e8fb89ea5a38aa3d3d6f07044cee264926c603b767d0b13795ddafa9ea4"}
May 20 15:35:16.088971 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:16.088934    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dp8ml" event={"ID":"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64","Type":"ContainerStarted","Data":"117ce950b5e9c2a0eb5e47c2c037f41ad5dd0ad5912d229289a2246d9040ca3d"}
May 20 15:35:16.088971 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:16.088976    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dp8ml" event={"ID":"3bc2640c-ca66-4ec8-89f5-a89ffb6ece64","Type":"ContainerStarted","Data":"168df49387a36eff723fbe2629de4ddf3023b2931dbfcec64d13e0a2cb8134f3"}
May 20 15:35:16.089361 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:16.089086    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:16.111029 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:16.110980    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-dp8ml" podStartSLOduration=129.53467941 podStartE2EDuration="2m11.110965963s" podCreationTimestamp="2026-05-20 15:33:05 +0000 UTC" firstStartedPulling="2026-05-20 15:35:14.310438946 +0000 UTC m=+162.362118380" lastFinishedPulling="2026-05-20 15:35:15.886725483 +0000 UTC m=+163.938404933" observedRunningTime="2026-05-20 15:35:16.11025098 +0000 UTC m=+164.161930436" watchObservedRunningTime="2026-05-20 15:35:16.110965963 +0000 UTC m=+164.162645419"
May 20 15:35:22.561376 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:22.561299    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:35:23.075225 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.075186    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbfcd"]
May 20 15:35:23.077462 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.077437    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.079999 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.079976    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 15:35:23.081284 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.081265    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6wcqs\""
May 20 15:35:23.081421 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.081311    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 15:35:23.088195 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.088171    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbfcd"]
May 20 15:35:23.146309 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.146260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4effab22-6999-457a-9f8e-f8ab7d0cb642-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.146494 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.146340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4effab22-6999-457a-9f8e-f8ab7d0cb642-data-volume\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.146494 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.146366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mgw\" (UniqueName: \"kubernetes.io/projected/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-api-access-98mgw\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.146494 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.146410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.146494 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.146478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4effab22-6999-457a-9f8e-f8ab7d0cb642-crio-socket\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.161184 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.161154    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"]
May 20 15:35:23.162965 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.162947    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.165467 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.165442    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 20 15:35:23.165592 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.165495    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 20 15:35:23.165592 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.165516    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j7f9l\""
May 20 15:35:23.175395 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.175367    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"]
May 20 15:35:23.247785 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247848    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4effab22-6999-457a-9f8e-f8ab7d0cb642-crio-socket\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247877    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4effab22-6999-457a-9f8e-f8ab7d0cb642-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247932    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4effab22-6999-457a-9f8e-f8ab7d0cb642-data-volume\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247974    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4effab22-6999-457a-9f8e-f8ab7d0cb642-crio-socket\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.247982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.247980    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98mgw\" (UniqueName: \"kubernetes.io/projected/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-api-access-98mgw\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.248204 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.248058    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.248356 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.248338    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4effab22-6999-457a-9f8e-f8ab7d0cb642-data-volume\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.248604 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.248578    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.250298 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.250277    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4effab22-6999-457a-9f8e-f8ab7d0cb642-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.261161 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.261127    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mgw\" (UniqueName: \"kubernetes.io/projected/4effab22-6999-457a-9f8e-f8ab7d0cb642-kube-api-access-98mgw\") pod \"insights-runtime-extractor-fbfcd\" (UID: \"4effab22-6999-457a-9f8e-f8ab7d0cb642\") " pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.349013 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.348924    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.349013 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.348988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.349541 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.349519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.351348 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.351330    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/174ef8dd-4c22-42da-9ed3-3572ad6a0af2-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zl44r\" (UID: \"174ef8dd-4c22-42da-9ed3-3572ad6a0af2\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.386502 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.386467    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbfcd"
May 20 15:35:23.472194 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.472164    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"
May 20 15:35:23.529074 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.529046    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbfcd"]
May 20 15:35:23.533059 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:23.533028    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4effab22_6999_457a_9f8e_f8ab7d0cb642.slice/crio-ec800c7b83eb7b4399f6b0486d07a902443c279d58750e1a0ecaa4ca1472ea38 WatchSource:0}: Error finding container ec800c7b83eb7b4399f6b0486d07a902443c279d58750e1a0ecaa4ca1472ea38: Status 404 returned error can't find the container with id ec800c7b83eb7b4399f6b0486d07a902443c279d58750e1a0ecaa4ca1472ea38
May 20 15:35:23.560184 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.560155    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:35:23.562852 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.562816    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94zvt\""
May 20 15:35:23.571044 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.571022    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nfv2f"
May 20 15:35:23.615788 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.615756    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r"]
May 20 15:35:23.619173 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:23.619141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174ef8dd_4c22_42da_9ed3_3572ad6a0af2.slice/crio-41f883a66b4192126f605689cc617a636a0740ac216a9a350652732975a2f9a4 WatchSource:0}: Error finding container 41f883a66b4192126f605689cc617a636a0740ac216a9a350652732975a2f9a4: Status 404 returned error can't find the container with id 41f883a66b4192126f605689cc617a636a0740ac216a9a350652732975a2f9a4
May 20 15:35:23.702845 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:23.702794    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nfv2f"]
May 20 15:35:23.706715 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:23.706684    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a52853_c484_4669_b435_6a08ebedd3de.slice/crio-a00559128fc0f9256769c19396005e239b5391c293846c300ad2ea3aaa6676dd WatchSource:0}: Error finding container a00559128fc0f9256769c19396005e239b5391c293846c300ad2ea3aaa6676dd: Status 404 returned error can't find the container with id a00559128fc0f9256769c19396005e239b5391c293846c300ad2ea3aaa6676dd
May 20 15:35:24.111955 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.111920    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbfcd" event={"ID":"4effab22-6999-457a-9f8e-f8ab7d0cb642","Type":"ContainerStarted","Data":"d256953ed6d2f8c2ee37c2fd1c879501e5d7769361f4c69f606001ae39ff8ebc"}
May 20 15:35:24.112104 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.111959    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbfcd" event={"ID":"4effab22-6999-457a-9f8e-f8ab7d0cb642","Type":"ContainerStarted","Data":"ec800c7b83eb7b4399f6b0486d07a902443c279d58750e1a0ecaa4ca1472ea38"}
May 20 15:35:24.113025 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.112994    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r" event={"ID":"174ef8dd-4c22-42da-9ed3-3572ad6a0af2","Type":"ContainerStarted","Data":"41f883a66b4192126f605689cc617a636a0740ac216a9a350652732975a2f9a4"}
May 20 15:35:24.113917 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.113892    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nfv2f" event={"ID":"54a52853-c484-4669-b435-6a08ebedd3de","Type":"ContainerStarted","Data":"a00559128fc0f9256769c19396005e239b5391c293846c300ad2ea3aaa6676dd"}
May 20 15:35:24.560775 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.560693    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:24.563655 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.563627    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2gccf\""
May 20 15:35:24.572254 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.571862    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:24.762276 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.762199    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:35:24.765357 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.765297    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d3b96de-681f-41be-8245-a913e6bfcc42-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vt6qc\" (UID: \"7d3b96de-681f-41be-8245-a913e6bfcc42\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:35:24.931966 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:24.931935    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"
May 20 15:35:25.082022 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.081818    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:35:25.085471 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:25.085384    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a49505_01a8_4e66_b7fc_49f464354bd3.slice/crio-8525ad2b5d86bf4240e05b886a43dc6fb9071ac830fbe31919ed4607b8465af4 WatchSource:0}: Error finding container 8525ad2b5d86bf4240e05b886a43dc6fb9071ac830fbe31919ed4607b8465af4: Status 404 returned error can't find the container with id 8525ad2b5d86bf4240e05b886a43dc6fb9071ac830fbe31919ed4607b8465af4
May 20 15:35:25.107278 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.107203    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc"]
May 20 15:35:25.116789 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:25.116754    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3b96de_681f_41be_8245_a913e6bfcc42.slice/crio-2fe0914ff9353e6c8dc98fb80d71581fa80c65cb89249b1693e5eec2a6d14841 WatchSource:0}: Error finding container 2fe0914ff9353e6c8dc98fb80d71581fa80c65cb89249b1693e5eec2a6d14841: Status 404 returned error can't find the container with id 2fe0914ff9353e6c8dc98fb80d71581fa80c65cb89249b1693e5eec2a6d14841
May 20 15:35:25.120099 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.120051    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbfcd" event={"ID":"4effab22-6999-457a-9f8e-f8ab7d0cb642","Type":"ContainerStarted","Data":"1e4ff6dd5316aa3a3439a9af4f4f617bf8ee3d1ed3023dce3081ff0596c5623d"}
May 20 15:35:25.121604 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.121518    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" event={"ID":"35a49505-01a8-4e66-b7fc-49f464354bd3","Type":"ContainerStarted","Data":"8525ad2b5d86bf4240e05b886a43dc6fb9071ac830fbe31919ed4607b8465af4"}
May 20 15:35:25.123210 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.123182    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r" event={"ID":"174ef8dd-4c22-42da-9ed3-3572ad6a0af2","Type":"ContainerStarted","Data":"686c2e8be054938920c540a1a71265323d66e8d13e44a82cf5580f0ac75fab5c"}
May 20 15:35:25.141037 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:25.140982    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zl44r" podStartSLOduration=0.829378149 podStartE2EDuration="2.140963514s" podCreationTimestamp="2026-05-20 15:35:23 +0000 UTC" firstStartedPulling="2026-05-20 15:35:23.621397746 +0000 UTC m=+171.673077181" lastFinishedPulling="2026-05-20 15:35:24.932983108 +0000 UTC m=+172.984662546" observedRunningTime="2026-05-20 15:35:25.139898112 +0000 UTC m=+173.191577571" watchObservedRunningTime="2026-05-20 15:35:25.140963514 +0000 UTC m=+173.192642972"
May 20 15:35:26.093857 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:26.093815    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dp8ml"
May 20 15:35:26.128430 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:26.128392    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" event={"ID":"35a49505-01a8-4e66-b7fc-49f464354bd3","Type":"ContainerStarted","Data":"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"}
May 20 15:35:26.128685 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:26.128652    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:26.130413 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:26.130371    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc" event={"ID":"7d3b96de-681f-41be-8245-a913e6bfcc42","Type":"ContainerStarted","Data":"2fe0914ff9353e6c8dc98fb80d71581fa80c65cb89249b1693e5eec2a6d14841"}
May 20 15:35:26.149727 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:26.149666    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" podStartSLOduration=173.149645487 podStartE2EDuration="2m53.149645487s" podCreationTimestamp="2026-05-20 15:32:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:35:26.14897036 +0000 UTC m=+174.200649819" watchObservedRunningTime="2026-05-20 15:35:26.149645487 +0000 UTC m=+174.201324946"
May 20 15:35:27.136512 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.136473    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nfv2f" event={"ID":"54a52853-c484-4669-b435-6a08ebedd3de","Type":"ContainerStarted","Data":"90eed91c2252c21cabdec9af5ab1920f643620e09501bdd87d65b2942736dfb6"}
May 20 15:35:27.137994 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.137967    2559 generic.go:358] "Generic (PLEG): container finished" podID="d633a685-9c75-42cf-9f9a-56f98e9d15f7" containerID="d388339a0fcac806f4c56cceb190a1cb1b89cb7aff046dec035815774fb07a0b" exitCode=255
May 20 15:35:27.138138 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.138045    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr" event={"ID":"d633a685-9c75-42cf-9f9a-56f98e9d15f7","Type":"ContainerDied","Data":"d388339a0fcac806f4c56cceb190a1cb1b89cb7aff046dec035815774fb07a0b"}
May 20 15:35:27.140298 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.140273    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbfcd" event={"ID":"4effab22-6999-457a-9f8e-f8ab7d0cb642","Type":"ContainerStarted","Data":"ecc8282509cc553eb20d76145b0287c1be0380d75e1367dccc40653adf5213a0"}
May 20 15:35:27.145153 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.145135    2559 scope.go:117] "RemoveContainer" containerID="d388339a0fcac806f4c56cceb190a1cb1b89cb7aff046dec035815774fb07a0b"
May 20 15:35:27.166386 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.166326    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nfv2f" podStartSLOduration=139.792576668 podStartE2EDuration="2m22.166306405s" podCreationTimestamp="2026-05-20 15:33:05 +0000 UTC" firstStartedPulling="2026-05-20 15:35:23.708523701 +0000 UTC m=+171.760203136" lastFinishedPulling="2026-05-20 15:35:26.082253435 +0000 UTC m=+174.133932873" observedRunningTime="2026-05-20 15:35:27.165306904 +0000 UTC m=+175.216986360" watchObservedRunningTime="2026-05-20 15:35:27.166306405 +0000 UTC m=+175.217985863"
May 20 15:35:27.191318 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.191269    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbfcd" podStartSLOduration=1.718186063 podStartE2EDuration="4.191252899s" podCreationTimestamp="2026-05-20 15:35:23 +0000 UTC" firstStartedPulling="2026-05-20 15:35:23.605730455 +0000 UTC m=+171.657409889" lastFinishedPulling="2026-05-20 15:35:26.078797282 +0000 UTC m=+174.130476725" observedRunningTime="2026-05-20 15:35:27.189665176 +0000 UTC m=+175.241344637" watchObservedRunningTime="2026-05-20 15:35:27.191252899 +0000 UTC m=+175.242932356"
May 20 15:35:27.972150 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.972112    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"]
May 20 15:35:27.975181 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.975165    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:27.977529 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.977500    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 15:35:27.977652 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.977571    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tdzc9\""
May 20 15:35:27.983786 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:27.983762    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"]
May 20 15:35:28.095386 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.095345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3e34e40-7673-4d06-b3b5-d2ca51b5070e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp\" (UID: \"b3e34e40-7673-4d06-b3b5-d2ca51b5070e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:28.144071 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.144034    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9549c895d-pc8dr" event={"ID":"d633a685-9c75-42cf-9f9a-56f98e9d15f7","Type":"ContainerStarted","Data":"32c50fb4a4ded7225759b792db3fd8a59975729370c5017e01c7ca4420d3dfd7"}
May 20 15:35:28.145295 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.145263    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc" event={"ID":"7d3b96de-681f-41be-8245-a913e6bfcc42","Type":"ContainerStarted","Data":"8056d27a5a057c80adcf0e962162855bd09966cc73032afda47cde01633362e4"}
May 20 15:35:28.196539 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.196499    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3e34e40-7673-4d06-b3b5-d2ca51b5070e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp\" (UID: \"b3e34e40-7673-4d06-b3b5-d2ca51b5070e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:28.199077 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.199056    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b3e34e40-7673-4d06-b3b5-d2ca51b5070e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp\" (UID: \"b3e34e40-7673-4d06-b3b5-d2ca51b5070e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:28.283967 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.283796    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:28.410785 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.410734    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vt6qc" podStartSLOduration=34.088249551 podStartE2EDuration="36.410717504s" podCreationTimestamp="2026-05-20 15:34:52 +0000 UTC" firstStartedPulling="2026-05-20 15:35:25.119580917 +0000 UTC m=+173.171260353" lastFinishedPulling="2026-05-20 15:35:27.442048864 +0000 UTC m=+175.493728306" observedRunningTime="2026-05-20 15:35:28.180470208 +0000 UTC m=+176.232149689" watchObservedRunningTime="2026-05-20 15:35:28.410717504 +0000 UTC m=+176.462396960"
May 20 15:35:28.411614 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:28.411595    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"]
May 20 15:35:28.414481 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:28.414451    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e34e40_7673_4d06_b3b5_d2ca51b5070e.slice/crio-f48335565d03c4c8c5892de6df4ba836363da0cac4f3c1a58ade9a3344316d6b WatchSource:0}: Error finding container f48335565d03c4c8c5892de6df4ba836363da0cac4f3c1a58ade9a3344316d6b: Status 404 returned error can't find the container with id f48335565d03c4c8c5892de6df4ba836363da0cac4f3c1a58ade9a3344316d6b
May 20 15:35:29.149745 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:29.149702    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp" event={"ID":"b3e34e40-7673-4d06-b3b5-d2ca51b5070e","Type":"ContainerStarted","Data":"f48335565d03c4c8c5892de6df4ba836363da0cac4f3c1a58ade9a3344316d6b"}
May 20 15:35:30.154080 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:30.154035    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp" event={"ID":"b3e34e40-7673-4d06-b3b5-d2ca51b5070e","Type":"ContainerStarted","Data":"03ad7a88054ebad35a0bb1915d360312f43effa68168220398a96746e1657818"}
May 20 15:35:30.154576 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:30.154250    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:30.158851 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:30.158807    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp"
May 20 15:35:30.178136 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:30.178084    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp" podStartSLOduration=2.136148337 podStartE2EDuration="3.178070425s" podCreationTimestamp="2026-05-20 15:35:27 +0000 UTC" firstStartedPulling="2026-05-20 15:35:28.416455286 +0000 UTC m=+176.468134720" lastFinishedPulling="2026-05-20 15:35:29.45837737 +0000 UTC m=+177.510056808" observedRunningTime="2026-05-20 15:35:30.177402983 +0000 UTC m=+178.229082440" watchObservedRunningTime="2026-05-20 15:35:30.178070425 +0000 UTC m=+178.229749882"
May 20 15:35:35.452716 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.452675    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"]
May 20 15:35:35.457731 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.457694    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.461247 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.461221    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 20 15:35:35.461986 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.461966    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-78nm2\""
May 20 15:35:35.462109 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.461966    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 20 15:35:35.462182 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.462159    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 15:35:35.462795 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.462776    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"]
May 20 15:35:35.466770 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.466754    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.469555 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.469531    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5b6kh\""
May 20 15:35:35.469749 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.469731    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 20 15:35:35.469951 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.469890    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 20 15:35:35.470179 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.470149    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"]
May 20 15:35:35.470496 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.470478    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 20 15:35:35.476710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.476688    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"]
May 20 15:35:35.535470 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.535436    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cq7p6"]
May 20 15:35:35.538766 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.538748    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.541104 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.541083    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 15:35:35.541215 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.541192    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 15:35:35.541370 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.541357    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 15:35:35.541414 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.541373    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ttrgj\""
May 20 15:35:35.558468 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.558468 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhwk\" (UniqueName: \"kubernetes.io/projected/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-api-access-rdhwk\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558934 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.558934 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.558783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlmdd\" (UniqueName: \"kubernetes.io/projected/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-kube-api-access-tlmdd\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.660287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-sys\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.660466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-root\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.660466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xs2x\" (UniqueName: \"kubernetes.io/projected/72704c01-ee13-472c-88b0-37f0ebe7e71e-kube-api-access-2xs2x\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.660466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660395    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.660466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660436    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.660466 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-wtmp\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660497    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660580    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660609    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660638    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660665    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.660710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-metrics-client-ca\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660721    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlmdd\" (UniqueName: \"kubernetes.io/projected/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-kube-api-access-tlmdd\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-tls\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-textfile\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660900    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.661051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.660925    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhwk\" (UniqueName: \"kubernetes.io/projected/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-api-access-rdhwk\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.661543 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:35.661430    2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 20 15:35:35.661543 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:35.661520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls podName:6c0a26d9-f861-4e8f-b844-0a6e9be2b146 nodeName:}" failed. No retries permitted until 2026-05-20 15:35:36.161497025 +0000 UTC m=+184.213176463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-gxwgm" (UID: "6c0a26d9-f861-4e8f-b844-0a6e9be2b146") : secret "openshift-state-metrics-tls" not found
May 20 15:35:35.661747 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:35.661542    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 20 15:35:35.661747 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:35.661646    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls podName:22b83d3d-4397-4ad6-83be-1d2f2a2038fd nodeName:}" failed. No retries permitted until 2026-05-20 15:35:36.161626092 +0000 UTC m=+184.213305528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-vr4d8" (UID: "22b83d3d-4397-4ad6-83be-1d2f2a2038fd") : secret "kube-state-metrics-tls" not found
May 20 15:35:35.661747 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.661704    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.662206 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.662143    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.662206 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.662190    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.662375 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.662240    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.663934 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.663910    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.664032 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.664012    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.673242 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.673209    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlmdd\" (UniqueName: \"kubernetes.io/projected/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-kube-api-access-tlmdd\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:35.673416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.673393    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhwk\" (UniqueName: \"kubernetes.io/projected/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-api-access-rdhwk\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:35.762271 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762170    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-metrics-client-ca\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762271 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762218    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-tls\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762271 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762260    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762303    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-textfile\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762355    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-sys\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762375    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-root\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762398    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xs2x\" (UniqueName: \"kubernetes.io/projected/72704c01-ee13-472c-88b0-37f0ebe7e71e-kube-api-access-2xs2x\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762425    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-wtmp\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762469    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-sys\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-root\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762553 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762473    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762633    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-wtmp\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762755    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-textfile\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.762943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.762901    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-metrics-client-ca\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.763072 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.763019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.765007 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.764990    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.765107 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.765090    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72704c01-ee13-472c-88b0-37f0ebe7e71e-node-exporter-tls\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.770779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.770757    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xs2x\" (UniqueName: \"kubernetes.io/projected/72704c01-ee13-472c-88b0-37f0ebe7e71e-kube-api-access-2xs2x\") pod \"node-exporter-cq7p6\" (UID: \"72704c01-ee13-472c-88b0-37f0ebe7e71e\") " pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.847950 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:35.847909    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cq7p6"
May 20 15:35:35.856360 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:35.856326    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72704c01_ee13_472c_88b0_37f0ebe7e71e.slice/crio-4034e172a1839ca965a4da3d85124b7ae7a8eac6533cc828b02a9d1f4b997228 WatchSource:0}: Error finding container 4034e172a1839ca965a4da3d85124b7ae7a8eac6533cc828b02a9d1f4b997228: Status 404 returned error can't find the container with id 4034e172a1839ca965a4da3d85124b7ae7a8eac6533cc828b02a9d1f4b997228
May 20 15:35:36.164928 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.164890    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:36.165126 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.164950    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:36.167523 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.167490    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c0a26d9-f861-4e8f-b844-0a6e9be2b146-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-gxwgm\" (UID: \"6c0a26d9-f861-4e8f-b844-0a6e9be2b146\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:36.167523 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.167519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22b83d3d-4397-4ad6-83be-1d2f2a2038fd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-vr4d8\" (UID: \"22b83d3d-4397-4ad6-83be-1d2f2a2038fd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:36.169734 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.169707    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cq7p6" event={"ID":"72704c01-ee13-472c-88b0-37f0ebe7e71e","Type":"ContainerStarted","Data":"4034e172a1839ca965a4da3d85124b7ae7a8eac6533cc828b02a9d1f4b997228"}
May 20 15:35:36.370881 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.370824    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"
May 20 15:35:36.377849 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.377785    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"
May 20 15:35:36.543715 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.543602    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm"]
May 20 15:35:36.546562 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:36.546536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0a26d9_f861_4e8f_b844_0a6e9be2b146.slice/crio-7dda85bcdd5b85e36392d57c336c3e42ca44783871dd69b49b33b745f3c7bc27 WatchSource:0}: Error finding container 7dda85bcdd5b85e36392d57c336c3e42ca44783871dd69b49b33b745f3c7bc27: Status 404 returned error can't find the container with id 7dda85bcdd5b85e36392d57c336c3e42ca44783871dd69b49b33b745f3c7bc27
May 20 15:35:36.568463 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:36.568088    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8"]
May 20 15:35:36.571437 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:36.571398    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b83d3d_4397_4ad6_83be_1d2f2a2038fd.slice/crio-f849f7a60e762c0dcedabca91ebabb46ab2e0e587c66a13f5e9652aa59c76529 WatchSource:0}: Error finding container f849f7a60e762c0dcedabca91ebabb46ab2e0e587c66a13f5e9652aa59c76529: Status 404 returned error can't find the container with id f849f7a60e762c0dcedabca91ebabb46ab2e0e587c66a13f5e9652aa59c76529
May 20 15:35:37.174850 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.174747    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm" event={"ID":"6c0a26d9-f861-4e8f-b844-0a6e9be2b146","Type":"ContainerStarted","Data":"675464065e698bc33d594d8fc6f542774969d9b212fa0e54ac2c21fe5c2e7989"}
May 20 15:35:37.174850 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.174794    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm" event={"ID":"6c0a26d9-f861-4e8f-b844-0a6e9be2b146","Type":"ContainerStarted","Data":"2f2dc446f32d7ace09732bc5859be162b18a6627714b74833e1de1b20e152a8a"}
May 20 15:35:37.174850 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.174807    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm" event={"ID":"6c0a26d9-f861-4e8f-b844-0a6e9be2b146","Type":"ContainerStarted","Data":"7dda85bcdd5b85e36392d57c336c3e42ca44783871dd69b49b33b745f3c7bc27"}
May 20 15:35:37.176536 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.176505    2559 generic.go:358] "Generic (PLEG): container finished" podID="72704c01-ee13-472c-88b0-37f0ebe7e71e" containerID="1e579193e97c97458e1a4fb22bdcb51f7f4e9d83ef82a2e48363378d77ed44e1" exitCode=0
May 20 15:35:37.176749 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.176590    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cq7p6" event={"ID":"72704c01-ee13-472c-88b0-37f0ebe7e71e","Type":"ContainerDied","Data":"1e579193e97c97458e1a4fb22bdcb51f7f4e9d83ef82a2e48363378d77ed44e1"}
May 20 15:35:37.177800 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:37.177780    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8" event={"ID":"22b83d3d-4397-4ad6-83be-1d2f2a2038fd","Type":"ContainerStarted","Data":"f849f7a60e762c0dcedabca91ebabb46ab2e0e587c66a13f5e9652aa59c76529"}
May 20 15:35:38.183071 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.183014    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm" event={"ID":"6c0a26d9-f861-4e8f-b844-0a6e9be2b146","Type":"ContainerStarted","Data":"ff61c95e68b16d914ff008b437b5480aba206fa21680c50132c39240380956ee"}
May 20 15:35:38.186237 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.186210    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cq7p6" event={"ID":"72704c01-ee13-472c-88b0-37f0ebe7e71e","Type":"ContainerStarted","Data":"8af0fb4a5e74410ae3a8a50d6b2b1a01b55883f9c669a81583d98360b8977305"}
May 20 15:35:38.186354 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.186244    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cq7p6" event={"ID":"72704c01-ee13-472c-88b0-37f0ebe7e71e","Type":"ContainerStarted","Data":"3be3ce2ff4c4aef789dd33acd1d4889fe8fe0573acb474b1134798c952e52238"}
May 20 15:35:38.188860 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.188809    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8" event={"ID":"22b83d3d-4397-4ad6-83be-1d2f2a2038fd","Type":"ContainerStarted","Data":"4fba7b9321b420d518e629a77e0f8ce581d9fa6f8814576f0602ecf6866e0f24"}
May 20 15:35:38.203545 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.203488    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-gxwgm" podStartSLOduration=2.053488509 podStartE2EDuration="3.203469502s" podCreationTimestamp="2026-05-20 15:35:35 +0000 UTC" firstStartedPulling="2026-05-20 15:35:36.905963277 +0000 UTC m=+184.957642712" lastFinishedPulling="2026-05-20 15:35:38.055944267 +0000 UTC m=+186.107623705" observedRunningTime="2026-05-20 15:35:38.202759846 +0000 UTC m=+186.254439303" watchObservedRunningTime="2026-05-20 15:35:38.203469502 +0000 UTC m=+186.255148960"
May 20 15:35:38.229063 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.228975    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cq7p6" podStartSLOduration=2.195338092 podStartE2EDuration="3.228955073s" podCreationTimestamp="2026-05-20 15:35:35 +0000 UTC" firstStartedPulling="2026-05-20 15:35:35.858019016 +0000 UTC m=+183.909698451" lastFinishedPulling="2026-05-20 15:35:36.891635991 +0000 UTC m=+184.943315432" observedRunningTime="2026-05-20 15:35:38.228371778 +0000 UTC m=+186.280051239" watchObservedRunningTime="2026-05-20 15:35:38.228955073 +0000 UTC m=+186.280634591"
May 20 15:35:38.567051 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.567018    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"]
May 20 15:35:38.570670 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.570648    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.573483 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573456    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 20 15:35:38.573599 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573456    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 20 15:35:38.573660 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573605    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 20 15:35:38.573660 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573627    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 20 15:35:38.573751 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573704    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 20 15:35:38.573823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.573713    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4d4839mbudrm4\""
May 20 15:35:38.574127 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.574111    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pdxfx\""
May 20 15:35:38.583476 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.583447    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"]
May 20 15:35:38.685927 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.685892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686122 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.685943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686122 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.685999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ada298-59c0-4281-84e3-bb01345b61df-metrics-client-ca\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686122 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.686038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686293 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.686133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbkbs\" (UniqueName: \"kubernetes.io/projected/76ada298-59c0-4281-84e3-bb01345b61df-kube-api-access-nbkbs\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686293 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.686202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686293 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.686238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.686293 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.686276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-grpc-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787230 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787188    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-grpc-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787401 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787256    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787401 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787299    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787401 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787323    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ada298-59c0-4281-84e3-bb01345b61df-metrics-client-ca\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787401 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787349    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787401 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787398    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbkbs\" (UniqueName: \"kubernetes.io/projected/76ada298-59c0-4281-84e3-bb01345b61df-kube-api-access-nbkbs\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787653 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787445    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.787653 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.787473    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.788982 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.788931    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ada298-59c0-4281-84e3-bb01345b61df-metrics-client-ca\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790468 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790468 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790530    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-grpc-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790589    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790778 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790761    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-tls\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.790870 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.790820    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ada298-59c0-4281-84e3-bb01345b61df-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.797813 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.797784    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbkbs\" (UniqueName: \"kubernetes.io/projected/76ada298-59c0-4281-84e3-bb01345b61df-kube-api-access-nbkbs\") pod \"thanos-querier-65bbdbdb8-d7rjd\" (UID: \"76ada298-59c0-4281-84e3-bb01345b61df\") " pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:38.880687 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:38.880601    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:39.039031 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.039006    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"]
May 20 15:35:39.041823 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:39.041788    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ada298_59c0_4281_84e3_bb01345b61df.slice/crio-8069a04660f4c17e29c96a4ca3f7341865fb12ccdab53b675e609a4169363e8a WatchSource:0}: Error finding container 8069a04660f4c17e29c96a4ca3f7341865fb12ccdab53b675e609a4169363e8a: Status 404 returned error can't find the container with id 8069a04660f4c17e29c96a4ca3f7341865fb12ccdab53b675e609a4169363e8a
May 20 15:35:39.196248 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.196125    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8" event={"ID":"22b83d3d-4397-4ad6-83be-1d2f2a2038fd","Type":"ContainerStarted","Data":"16152d642a9a8ea2e0f9bb5223370fa2cd2da496e1276d37f395f2cc09a83cc9"}
May 20 15:35:39.196248 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.196199    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8" event={"ID":"22b83d3d-4397-4ad6-83be-1d2f2a2038fd","Type":"ContainerStarted","Data":"fe7edc2004a5210200ae53fbb68859111aeb2e33382bc684573997d107669ce0"}
May 20 15:35:39.197293 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.197272    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"8069a04660f4c17e29c96a4ca3f7341865fb12ccdab53b675e609a4169363e8a"}
May 20 15:35:39.226617 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.226555    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-vr4d8" podStartSLOduration=2.7474855590000002 podStartE2EDuration="4.226539525s" podCreationTimestamp="2026-05-20 15:35:35 +0000 UTC" firstStartedPulling="2026-05-20 15:35:36.573972487 +0000 UTC m=+184.625651923" lastFinishedPulling="2026-05-20 15:35:38.053026446 +0000 UTC m=+186.104705889" observedRunningTime="2026-05-20 15:35:39.225421632 +0000 UTC m=+187.277101103" watchObservedRunningTime="2026-05-20 15:35:39.226539525 +0000 UTC m=+187.278219196"
May 20 15:35:39.283309 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.283275    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-762cj"]
May 20 15:35:39.287919 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.287898    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:39.290487 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.290449    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 15:35:39.290615 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.290563    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 15:35:39.290664 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.290622    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g4kkc\""
May 20 15:35:39.297865 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.297811    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-762cj"]
May 20 15:35:39.394820 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.394777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gg9t\" (UniqueName: \"kubernetes.io/projected/b4d81924-0896-4439-b6f5-12fa5a14e444-kube-api-access-5gg9t\") pod \"downloads-57bd96b888-762cj\" (UID: \"b4d81924-0896-4439-b6f5-12fa5a14e444\") " pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:39.496364 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.496269    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gg9t\" (UniqueName: \"kubernetes.io/projected/b4d81924-0896-4439-b6f5-12fa5a14e444-kube-api-access-5gg9t\") pod \"downloads-57bd96b888-762cj\" (UID: \"b4d81924-0896-4439-b6f5-12fa5a14e444\") " pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:39.507632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.507599    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gg9t\" (UniqueName: \"kubernetes.io/projected/b4d81924-0896-4439-b6f5-12fa5a14e444-kube-api-access-5gg9t\") pod \"downloads-57bd96b888-762cj\" (UID: \"b4d81924-0896-4439-b6f5-12fa5a14e444\") " pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:39.598587 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.598552    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:39.744792 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:39.744750    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-762cj"]
May 20 15:35:39.747774 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:39.747703    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d81924_0896_4439_b6f5_12fa5a14e444.slice/crio-9a17499d426dd8983d245e4b1ac4cb0e785a4145d377a50ca69bb0ab997df6ee WatchSource:0}: Error finding container 9a17499d426dd8983d245e4b1ac4cb0e785a4145d377a50ca69bb0ab997df6ee: Status 404 returned error can't find the container with id 9a17499d426dd8983d245e4b1ac4cb0e785a4145d377a50ca69bb0ab997df6ee
May 20 15:35:40.197970 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.197931    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"]
May 20 15:35:40.201507 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.201399    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:40.204475 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.204451    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-wgfvn\""
May 20 15:35:40.204799 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.204486    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-762cj" event={"ID":"b4d81924-0896-4439-b6f5-12fa5a14e444","Type":"ContainerStarted","Data":"9a17499d426dd8983d245e4b1ac4cb0e785a4145d377a50ca69bb0ab997df6ee"}
May 20 15:35:40.204799 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.204566    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 20 15:35:40.209357 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.209331    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"]
May 20 15:35:40.302943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.302899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xmlff\" (UID: \"a6015557-ebbc-4c16-bb03-37cdd9a0346d\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:40.404066 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.404029    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xmlff\" (UID: \"a6015557-ebbc-4c16-bb03-37cdd9a0346d\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:40.404263 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:40.404194    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 20 15:35:40.404330 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:35:40.404270    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert podName:a6015557-ebbc-4c16-bb03-37cdd9a0346d nodeName:}" failed. No retries permitted until 2026-05-20 15:35:40.904249642 +0000 UTC m=+188.955929081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-xmlff" (UID: "a6015557-ebbc-4c16-bb03-37cdd9a0346d") : secret "monitoring-plugin-cert" not found
May 20 15:35:40.909667 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.909627    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xmlff\" (UID: \"a6015557-ebbc-4c16-bb03-37cdd9a0346d\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:40.912742 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:40.912711    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6015557-ebbc-4c16-bb03-37cdd9a0346d-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xmlff\" (UID: \"a6015557-ebbc-4c16-bb03-37cdd9a0346d\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:41.117058 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:41.117015    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:41.298550 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:41.298519    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"]
May 20 15:35:41.302672 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:35:41.302636    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6015557_ebbc_4c16_bb03_37cdd9a0346d.slice/crio-36e58f9adf10cfef113f74d2481bdbf0929f2b03821ea9e09f1f86d05388ed41 WatchSource:0}: Error finding container 36e58f9adf10cfef113f74d2481bdbf0929f2b03821ea9e09f1f86d05388ed41: Status 404 returned error can't find the container with id 36e58f9adf10cfef113f74d2481bdbf0929f2b03821ea9e09f1f86d05388ed41
May 20 15:35:42.218242 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:42.218203    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff" event={"ID":"a6015557-ebbc-4c16-bb03-37cdd9a0346d","Type":"ContainerStarted","Data":"36e58f9adf10cfef113f74d2481bdbf0929f2b03821ea9e09f1f86d05388ed41"}
May 20 15:35:42.220719 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:42.220676    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"4745f08597a492d47982f7e1c263d367ba1e4c7af97a56e539825925d59accd7"}
May 20 15:35:42.220719 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:42.220718    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"dc8a884e8fc67cdfaa1f14d4b426b5510b16a19fa3d8105fdf8a8d8d7bb2550d"}
May 20 15:35:42.220955 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:42.220736    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"dfe042c4b202bf02a4d8d7c2011d37b6da3e30db6b3b9571468e87441a1c2c62"}
May 20 15:35:43.227558 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.227466    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"c475f0aabb3a233c1cc05923286cc8ba7a86aa514287c2f913647dd2b147771b"}
May 20 15:35:43.227558 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.227514    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"48a92d9bc49822757dddd6d4b515998d35309bc781d455efc88e7c2b2ae75610"}
May 20 15:35:43.227558 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.227529    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" event={"ID":"76ada298-59c0-4281-84e3-bb01345b61df","Type":"ContainerStarted","Data":"47d48e97eb5df4e1d1df2defe8c2e59117ea3607231591ad754c8303a06610ce"}
May 20 15:35:43.228146 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.227668    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:43.229519 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.229486    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff" event={"ID":"a6015557-ebbc-4c16-bb03-37cdd9a0346d","Type":"ContainerStarted","Data":"e9a8f327787479d621a15729a464416ca5d378640a91e60391aa6897e5268c9a"}
May 20 15:35:43.229743 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.229724    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:43.235814 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.235790    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff"
May 20 15:35:43.252327 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.252281    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd" podStartSLOduration=1.635670943 podStartE2EDuration="5.252264606s" podCreationTimestamp="2026-05-20 15:35:38 +0000 UTC" firstStartedPulling="2026-05-20 15:35:39.044186033 +0000 UTC m=+187.095865471" lastFinishedPulling="2026-05-20 15:35:42.660779696 +0000 UTC m=+190.712459134" observedRunningTime="2026-05-20 15:35:43.250800159 +0000 UTC m=+191.302479654" watchObservedRunningTime="2026-05-20 15:35:43.252264606 +0000 UTC m=+191.303944090"
May 20 15:35:43.268537 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:43.268478    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xmlff" podStartSLOduration=1.861837902 podStartE2EDuration="3.268458434s" podCreationTimestamp="2026-05-20 15:35:40 +0000 UTC" firstStartedPulling="2026-05-20 15:35:41.305489942 +0000 UTC m=+189.357169379" lastFinishedPulling="2026-05-20 15:35:42.712110462 +0000 UTC m=+190.763789911" observedRunningTime="2026-05-20 15:35:43.266619077 +0000 UTC m=+191.318298538" watchObservedRunningTime="2026-05-20 15:35:43.268458434 +0000 UTC m=+191.320137894"
May 20 15:35:45.412103 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:45.412069    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:35:45.417114 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:45.417084    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:35:49.240532 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:49.240500    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65bbdbdb8-d7rjd"
May 20 15:35:56.273742 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:56.273697    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-762cj" event={"ID":"b4d81924-0896-4439-b6f5-12fa5a14e444","Type":"ContainerStarted","Data":"990c5a88a6a587e39de1367311a18a0327ad9445fb2963ba48e00a69b06db372"}
May 20 15:35:56.274245 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:56.273982    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:56.288481 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:56.288447    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-762cj"
May 20 15:35:56.313958 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:35:56.313891    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-762cj" podStartSLOduration=1.37423789 podStartE2EDuration="17.313869967s" podCreationTimestamp="2026-05-20 15:35:39 +0000 UTC" firstStartedPulling="2026-05-20 15:35:39.749740866 +0000 UTC m=+187.801420301" lastFinishedPulling="2026-05-20 15:35:55.689372943 +0000 UTC m=+203.741052378" observedRunningTime="2026-05-20 15:35:56.29475609 +0000 UTC m=+204.346435559" watchObservedRunningTime="2026-05-20 15:35:56.313869967 +0000 UTC m=+204.365549425"
May 20 15:36:10.435368 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.435296    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3" containerName="registry" containerID="cri-o://3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0" gracePeriod=30
May 20 15:36:10.690523 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.690445    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:36:10.793008 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.792967    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5xjz\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793018    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793060    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793077    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793109    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793141    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793168    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793222 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793216    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets\") pod \"35a49505-01a8-4e66-b7fc-49f464354bd3\" (UID: \"35a49505-01a8-4e66-b7fc-49f464354bd3\") "
May 20 15:36:10.793818 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793740    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 15:36:10.793818 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.793750    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 15:36:10.795708 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.795652    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 15:36:10.795850 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.795814    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 15:36:10.795928 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.795887    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz" (OuterVolumeSpecName: "kube-api-access-f5xjz") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "kube-api-access-f5xjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:36:10.796022 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.796001    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:36:10.796071 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.796006    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:36:10.803791 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.803758    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "35a49505-01a8-4e66-b7fc-49f464354bd3" (UID: "35a49505-01a8-4e66-b7fc-49f464354bd3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:36:10.894116 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894068    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-certificates\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894116 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894107    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35a49505-01a8-4e66-b7fc-49f464354bd3-trusted-ca\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894116 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894119    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-image-registry-private-configuration\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894116 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894129    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-registry-tls\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894397 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894138    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35a49505-01a8-4e66-b7fc-49f464354bd3-ca-trust-extracted\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894397 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894147    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35a49505-01a8-4e66-b7fc-49f464354bd3-installation-pull-secrets\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894397 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894156    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5xjz\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-kube-api-access-f5xjz\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:10.894397 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:10.894164    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a49505-01a8-4e66-b7fc-49f464354bd3-bound-sa-token\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:36:11.317286 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.317248    2559 generic.go:358] "Generic (PLEG): container finished" podID="35a49505-01a8-4e66-b7fc-49f464354bd3" containerID="3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0" exitCode=0
May 20 15:36:11.317529 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.317297    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" event={"ID":"35a49505-01a8-4e66-b7fc-49f464354bd3","Type":"ContainerDied","Data":"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"}
May 20 15:36:11.317529 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.317330    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr" event={"ID":"35a49505-01a8-4e66-b7fc-49f464354bd3","Type":"ContainerDied","Data":"8525ad2b5d86bf4240e05b886a43dc6fb9071ac830fbe31919ed4607b8465af4"}
May 20 15:36:11.317529 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.317335    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8fd4cc45-xjtpr"
May 20 15:36:11.317529 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.317349    2559 scope.go:117] "RemoveContainer" containerID="3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"
May 20 15:36:11.325943 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.325922    2559 scope.go:117] "RemoveContainer" containerID="3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"
May 20 15:36:11.326223 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:36:11.326204    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0\": container with ID starting with 3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0 not found: ID does not exist" containerID="3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"
May 20 15:36:11.326285 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.326231    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0"} err="failed to get container status \"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0\": rpc error: code = NotFound desc = could not find container \"3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0\": container with ID starting with 3c0e5fe31dfa0bcde2d1a7eedec7346cad9e4521f153f0295dd214b9a8f3d7b0 not found: ID does not exist"
May 20 15:36:11.340437 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.340404    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:36:11.344745 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:11.344720    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b8fd4cc45-xjtpr"]
May 20 15:36:12.565249 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:12.565196    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3" path="/var/lib/kubelet/pods/35a49505-01a8-4e66-b7fc-49f464354bd3/volumes"
May 20 15:36:27.372656 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.372622    2559 generic.go:358] "Generic (PLEG): container finished" podID="30b189fc-aada-4e0f-a585-e598e637bc92" containerID="2cb110a3366ba79dc918a196e414b49e97f982401f722e693f93089d96a9c69e" exitCode=0
May 20 15:36:27.373128 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.372695    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-h24kw" event={"ID":"30b189fc-aada-4e0f-a585-e598e637bc92","Type":"ContainerDied","Data":"2cb110a3366ba79dc918a196e414b49e97f982401f722e693f93089d96a9c69e"}
May 20 15:36:27.373128 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.373112    2559 scope.go:117] "RemoveContainer" containerID="2cb110a3366ba79dc918a196e414b49e97f982401f722e693f93089d96a9c69e"
May 20 15:36:27.374135 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.374115    2559 generic.go:358] "Generic (PLEG): container finished" podID="5291f3b7-8eb5-4b39-8259-3713c171cb95" containerID="9721717d26217add677890fd9c858c0cdd0a86fc6e5318c1404f1ff0e58dee89" exitCode=0
May 20 15:36:27.374242 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.374184    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct" event={"ID":"5291f3b7-8eb5-4b39-8259-3713c171cb95","Type":"ContainerDied","Data":"9721717d26217add677890fd9c858c0cdd0a86fc6e5318c1404f1ff0e58dee89"}
May 20 15:36:27.374476 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:27.374461    2559 scope.go:117] "RemoveContainer" containerID="9721717d26217add677890fd9c858c0cdd0a86fc6e5318c1404f1ff0e58dee89"
May 20 15:36:28.378688 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:28.378656    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-h24kw" event={"ID":"30b189fc-aada-4e0f-a585-e598e637bc92","Type":"ContainerStarted","Data":"4a327d2bac167c854a65ab2cb0d20325de2b52b9b01b951672030af41be17329"}
May 20 15:36:28.380259 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:28.380238    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8n7ct" event={"ID":"5291f3b7-8eb5-4b39-8259-3713c171cb95","Type":"ContainerStarted","Data":"b92c79faa81db434edb56ced2c094add0d7d45d93873a510e6e734bfac1c2014"}
May 20 15:36:43.369165 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:43.369125    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:36:43.371520 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:43.371497    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633256f-cf71-47cc-8224-0bb5a10ff4c6-metrics-certs\") pod \"network-metrics-daemon-lflkp\" (UID: \"b633256f-cf71-47cc-8224-0bb5a10ff4c6\") " pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:36:43.565402 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:43.565371    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qfs\""
May 20 15:36:43.572971 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:43.572946    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lflkp"
May 20 15:36:43.701169 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:43.701145    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lflkp"]
May 20 15:36:43.703975 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:36:43.703947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633256f_cf71_47cc_8224_0bb5a10ff4c6.slice/crio-428bf4cd44331556a1829ccee64bb17f4400c0e2771fc1f7a1e07afec2b90849 WatchSource:0}: Error finding container 428bf4cd44331556a1829ccee64bb17f4400c0e2771fc1f7a1e07afec2b90849: Status 404 returned error can't find the container with id 428bf4cd44331556a1829ccee64bb17f4400c0e2771fc1f7a1e07afec2b90849
May 20 15:36:44.430811 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:44.430780    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lflkp" event={"ID":"b633256f-cf71-47cc-8224-0bb5a10ff4c6","Type":"ContainerStarted","Data":"428bf4cd44331556a1829ccee64bb17f4400c0e2771fc1f7a1e07afec2b90849"}
May 20 15:36:45.435674 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:45.435636    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lflkp" event={"ID":"b633256f-cf71-47cc-8224-0bb5a10ff4c6","Type":"ContainerStarted","Data":"337b465ab6fa5fc3c3584f8e8c4de80567e32d407dac708b4fefa1511cfb89ce"}
May 20 15:36:45.435674 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:45.435677    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lflkp" event={"ID":"b633256f-cf71-47cc-8224-0bb5a10ff4c6","Type":"ContainerStarted","Data":"cbb5fd64eb1ecfdc5f47b625de0749e984d7bb36842b24ca3325067d21de5082"}
May 20 15:36:45.458257 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:36:45.458204    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lflkp" podStartSLOduration=252.470402242 podStartE2EDuration="4m13.458184808s" podCreationTimestamp="2026-05-20 15:32:32 +0000 UTC" firstStartedPulling="2026-05-20 15:36:43.706319175 +0000 UTC m=+251.757998610" lastFinishedPulling="2026-05-20 15:36:44.694101739 +0000 UTC m=+252.745781176" observedRunningTime="2026-05-20 15:36:45.456437164 +0000 UTC m=+253.508116622" watchObservedRunningTime="2026-05-20 15:36:45.458184808 +0000 UTC m=+253.509864302"
May 20 15:37:32.468319 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:37:32.468291    2559 kubelet.go:1628] "Image garbage collection succeeded"
May 20 15:38:16.238766 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.238731    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"]
May 20 15:38:16.239207 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.239055    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3" containerName="registry"
May 20 15:38:16.239207 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.239067    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3" containerName="registry"
May 20 15:38:16.239207 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.239110    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="35a49505-01a8-4e66-b7fc-49f464354bd3" containerName="registry"
May 20 15:38:16.240952 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.240932    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.243696 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.243670    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 15:38:16.244897 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.244872    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-59tgz\""
May 20 15:38:16.244973 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.244872    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 15:38:16.250485 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.250459    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"]
May 20 15:38:16.379179 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.379142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdcn\" (UniqueName: \"kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.379407 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.379202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.379407 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.379279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.479679 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.479638    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdcn\" (UniqueName: \"kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.479881 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.479697    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.479881 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.479868    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.480052 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.480034    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.480164 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.480149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.490283 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.490215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdcn\" (UniqueName: \"kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.551142 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.551104    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:16.687966 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.687936    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"]
May 20 15:38:16.691345 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:38:16.691319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda9d7dd_6052_4ae1_8b5a_ab65ace8e52f.slice/crio-6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e WatchSource:0}: Error finding container 6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e: Status 404 returned error can't find the container with id 6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e
May 20 15:38:16.693119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.693101    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:38:16.702370 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:16.702343    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5" event={"ID":"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f","Type":"ContainerStarted","Data":"6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e"}
May 20 15:38:22.725332 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:22.725240    2559 generic.go:358] "Generic (PLEG): container finished" podID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerID="dd70d0ee99acc428d9ab2cc8541b506c2b81c9d63dbf7e59ccbf2e4b8f60a1a0" exitCode=0
May 20 15:38:22.725710 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:22.725327    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5" event={"ID":"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f","Type":"ContainerDied","Data":"dd70d0ee99acc428d9ab2cc8541b506c2b81c9d63dbf7e59ccbf2e4b8f60a1a0"}
May 20 15:38:25.736608 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:25.736571    2559 generic.go:358] "Generic (PLEG): container finished" podID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerID="ed22c73cd48e6ff344a0431f5b22d134fafcfe4853e5bb65759e747178efff2a" exitCode=0
May 20 15:38:25.737026 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:25.736640    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5" event={"ID":"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f","Type":"ContainerDied","Data":"ed22c73cd48e6ff344a0431f5b22d134fafcfe4853e5bb65759e747178efff2a"}
May 20 15:38:32.761359 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:32.761266    2559 generic.go:358] "Generic (PLEG): container finished" podID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerID="70e76e9448fe755c5462d1febf23c7aca7ccd725c83c0ad1ec3f3f5213aa7322" exitCode=0
May 20 15:38:32.761359 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:32.761311    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5" event={"ID":"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f","Type":"ContainerDied","Data":"70e76e9448fe755c5462d1febf23c7aca7ccd725c83c0ad1ec3f3f5213aa7322"}
May 20 15:38:33.887452 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:33.887419    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:34.032491 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.032457    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle\") pod \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") "
May 20 15:38:34.032674 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.032525    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util\") pod \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") "
May 20 15:38:34.032674 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.032584    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqdcn\" (UniqueName: \"kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn\") pod \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\" (UID: \"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f\") "
May 20 15:38:34.033104 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.033078    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle" (OuterVolumeSpecName: "bundle") pod "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" (UID: "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:38:34.034776 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.034748    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn" (OuterVolumeSpecName: "kube-api-access-kqdcn") pod "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" (UID: "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f"). InnerVolumeSpecName "kube-api-access-kqdcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:38:34.037056 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.037034    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util" (OuterVolumeSpecName: "util") pod "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" (UID: "bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:38:34.134049 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.133992    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqdcn\" (UniqueName: \"kubernetes.io/projected/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-kube-api-access-kqdcn\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:38:34.134049 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.134037    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-bundle\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:38:34.134049 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.134056    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f-util\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:38:34.768611 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.768579    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5" event={"ID":"bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f","Type":"ContainerDied","Data":"6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e"}
May 20 15:38:34.768611 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.768609    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29cv58l5"
May 20 15:38:34.768815 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:34.768615    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f9eb7f9de19849eb2952a8d192a8a287fa6b6d76c14586a34cb78969ad0400e"
May 20 15:38:37.964689 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.964655    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"]
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.964975    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="extract"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.964987    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="extract"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.965001    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="pull"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.965007    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="pull"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.965015    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="util"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.965023    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="util"
May 20 15:38:37.965084 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.965080    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="bda9d7dd-6052-4ae1-8b5a-ab65ace8e52f" containerName="extract"
May 20 15:38:37.985039 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.985007    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:37.987161 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.987123    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"]
May 20 15:38:37.988037 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.988011    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-87k94\""
May 20 15:38:37.988278 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.988260    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 20 15:38:37.988535 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.988510    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 20 15:38:37.988719 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:37.988700    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 20 15:38:38.169690 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.169646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46pd4\" (UniqueName: \"kubernetes.io/projected/532b1e5c-71d2-4fde-bcbc-5865154fe411-kube-api-access-46pd4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.169907 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.169741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/532b1e5c-71d2-4fde-bcbc-5865154fe411-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.270400 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.270297    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/532b1e5c-71d2-4fde-bcbc-5865154fe411-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.270579 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.270410    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46pd4\" (UniqueName: \"kubernetes.io/projected/532b1e5c-71d2-4fde-bcbc-5865154fe411-kube-api-access-46pd4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.272958 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.272922    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/532b1e5c-71d2-4fde-bcbc-5865154fe411-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.282663 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.282626    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46pd4\" (UniqueName: \"kubernetes.io/projected/532b1e5c-71d2-4fde-bcbc-5865154fe411-kube-api-access-46pd4\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9\" (UID: \"532b1e5c-71d2-4fde-bcbc-5865154fe411\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.296420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.296387    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:38.466398 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.466363    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"]
May 20 15:38:38.471478 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:38:38.471448    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532b1e5c_71d2_4fde_bcbc_5865154fe411.slice/crio-3f79ffbbea16a2d0a157e61f8667bcf5593faa6931d6a5948ea3bfb8b18dd365 WatchSource:0}: Error finding container 3f79ffbbea16a2d0a157e61f8667bcf5593faa6931d6a5948ea3bfb8b18dd365: Status 404 returned error can't find the container with id 3f79ffbbea16a2d0a157e61f8667bcf5593faa6931d6a5948ea3bfb8b18dd365
May 20 15:38:38.781987 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:38.781947    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9" event={"ID":"532b1e5c-71d2-4fde-bcbc-5865154fe411","Type":"ContainerStarted","Data":"3f79ffbbea16a2d0a157e61f8667bcf5593faa6931d6a5948ea3bfb8b18dd365"}
May 20 15:38:44.728616 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.728575    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5b26c"]
May 20 15:38:44.742463 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.742432    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5b26c"]
May 20 15:38:44.742665 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.742543    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.745540 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.745513    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 20 15:38:44.745681 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.745513    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
May 20 15:38:44.745681 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.745558    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8rxmz\""
May 20 15:38:44.804204 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.804169    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9" event={"ID":"532b1e5c-71d2-4fde-bcbc-5865154fe411","Type":"ContainerStarted","Data":"bb9910a2b5753aca559b04e3410945fc3eae7123fb265ce09c618511c5fac892"}
May 20 15:38:44.804394 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.804258    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:38:44.820039 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.820003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c59019b7-5e5d-4887-ac6a-3815df42d1a3-cabundle0\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.820205 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.820101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.820205 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.820150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9rc\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-kube-api-access-6s9rc\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.824224 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.823953    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9" podStartSLOduration=2.150951483 podStartE2EDuration="7.82393631s" podCreationTimestamp="2026-05-20 15:38:37 +0000 UTC" firstStartedPulling="2026-05-20 15:38:38.473145108 +0000 UTC m=+366.524824544" lastFinishedPulling="2026-05-20 15:38:44.146129936 +0000 UTC m=+372.197809371" observedRunningTime="2026-05-20 15:38:44.823149751 +0000 UTC m=+372.874829209" watchObservedRunningTime="2026-05-20 15:38:44.82393631 +0000 UTC m=+372.875615770"
May 20 15:38:44.921001 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.920963    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c59019b7-5e5d-4887-ac6a-3815df42d1a3-cabundle0\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.921227 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.921024    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.921227 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.921067    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9rc\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-kube-api-access-6s9rc\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.921227 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:44.921185    2559 secret.go:281] references non-existent secret key: ca.crt
May 20 15:38:44.921227 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:44.921205    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 15:38:44.921227 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:44.921215    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5b26c: references non-existent secret key: ca.crt
May 20 15:38:44.921433 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:44.921273    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates podName:c59019b7-5e5d-4887-ac6a-3815df42d1a3 nodeName:}" failed. No retries permitted until 2026-05-20 15:38:45.421254217 +0000 UTC m=+373.472933665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates") pod "keda-operator-ffbb595cb-5b26c" (UID: "c59019b7-5e5d-4887-ac6a-3815df42d1a3") : references non-existent secret key: ca.crt
May 20 15:38:44.921607 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.921587    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c59019b7-5e5d-4887-ac6a-3815df42d1a3-cabundle0\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:44.930287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:44.930261    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9rc\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-kube-api-access-6s9rc\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:45.002006 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.001921    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"]
May 20 15:38:45.017308 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.017273    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"]
May 20 15:38:45.017502 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.017371    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.020002 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.019976    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 20 15:38:45.021400 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.021378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.021534 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.021426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkn7\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-kube-api-access-zvkn7\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.021534 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.021456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.122492 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.122453    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.122771 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.122517    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkn7\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-kube-api-access-zvkn7\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.122771 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.122551    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.122771 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.122733    2559 secret.go:281] references non-existent secret key: tls.crt
May 20 15:38:45.122771 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.122752    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:38:45.122771 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.122769    2559 projected.go:264] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
May 20 15:38:45.123043 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.122794    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 20 15:38:45.123043 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.122790    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.123043 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.122901    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates podName:0ae0b3a6-c5ce-4509-bc25-b435f97f068d nodeName:}" failed. No retries permitted until 2026-05-20 15:38:45.622879293 +0000 UTC m=+373.674558743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates") pod "keda-metrics-apiserver-7c9f485588-xsm4q" (UID: "0ae0b3a6-c5ce-4509-bc25-b435f97f068d") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
May 20 15:38:45.136204 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.136175    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkn7\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-kube-api-access-zvkn7\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.294292 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.294254    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-q9cjw"]
May 20 15:38:45.296527 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.296510    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.299088 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.299065    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 20 15:38:45.307240 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.307211    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-q9cjw"]
May 20 15:38:45.323338 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.323304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.323491 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.323386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk7bs\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-kube-api-access-xk7bs\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.424010 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.423964    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.424052    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.424088    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk7bs\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-kube-api-access-xk7bs\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424108    2559 projected.go:264] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424135    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-cf49989db-q9cjw: secret "keda-admission-webhooks-certs" not found
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424192    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates podName:73d563b2-64ce-416f-a036-59c729bda3c6 nodeName:}" failed. No retries permitted until 2026-05-20 15:38:45.924174099 +0000 UTC m=+373.975853535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates") pod "keda-admission-cf49989db-q9cjw" (UID: "73d563b2-64ce-416f-a036-59c729bda3c6") : secret "keda-admission-webhooks-certs" not found
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424197    2559 secret.go:281] references non-existent secret key: ca.crt
May 20 15:38:45.424208 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424213    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 15:38:45.424559 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424222    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5b26c: references non-existent secret key: ca.crt
May 20 15:38:45.424559 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.424260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates podName:c59019b7-5e5d-4887-ac6a-3815df42d1a3 nodeName:}" failed. No retries permitted until 2026-05-20 15:38:46.424247579 +0000 UTC m=+374.475927013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates") pod "keda-operator-ffbb595cb-5b26c" (UID: "c59019b7-5e5d-4887-ac6a-3815df42d1a3") : references non-existent secret key: ca.crt
May 20 15:38:45.435979 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.435940    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk7bs\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-kube-api-access-xk7bs\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.625160 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.625062    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:45.625319 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.625207    2559 secret.go:281] references non-existent secret key: tls.crt
May 20 15:38:45.625319 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.625227    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:38:45.625319 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.625247    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q: references non-existent secret key: tls.crt
May 20 15:38:45.625319 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:45.625303    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates podName:0ae0b3a6-c5ce-4509-bc25-b435f97f068d nodeName:}" failed. No retries permitted until 2026-05-20 15:38:46.625288227 +0000 UTC m=+374.676967661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates") pod "keda-metrics-apiserver-7c9f485588-xsm4q" (UID: "0ae0b3a6-c5ce-4509-bc25-b435f97f068d") : references non-existent secret key: tls.crt
May 20 15:38:45.927767 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.927666    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:45.931196 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:45.931168    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/73d563b2-64ce-416f-a036-59c729bda3c6-certificates\") pod \"keda-admission-cf49989db-q9cjw\" (UID: \"73d563b2-64ce-416f-a036-59c729bda3c6\") " pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:46.207268 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:46.207170    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:46.343429 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:46.343370    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-q9cjw"]
May 20 15:38:46.346378 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:38:46.346349    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d563b2_64ce_416f_a036_59c729bda3c6.slice/crio-e1bad18af74468bdf1629fff89419b9f9c8962a88b27d97b8a6a7502919953d3 WatchSource:0}: Error finding container e1bad18af74468bdf1629fff89419b9f9c8962a88b27d97b8a6a7502919953d3: Status 404 returned error can't find the container with id e1bad18af74468bdf1629fff89419b9f9c8962a88b27d97b8a6a7502919953d3
May 20 15:38:46.432811 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:46.432774    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:46.432998 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.432977    2559 secret.go:281] references non-existent secret key: ca.crt
May 20 15:38:46.433057 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.433006    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 15:38:46.433057 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.433020    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5b26c: references non-existent secret key: ca.crt
May 20 15:38:46.433120 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.433085    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates podName:c59019b7-5e5d-4887-ac6a-3815df42d1a3 nodeName:}" failed. No retries permitted until 2026-05-20 15:38:48.433064816 +0000 UTC m=+376.484744258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates") pod "keda-operator-ffbb595cb-5b26c" (UID: "c59019b7-5e5d-4887-ac6a-3815df42d1a3") : references non-existent secret key: ca.crt
May 20 15:38:46.635391 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:46.635339    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:46.635603 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.635506    2559 secret.go:281] references non-existent secret key: tls.crt
May 20 15:38:46.635603 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.635528    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:38:46.635603 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.635550    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q: references non-existent secret key: tls.crt
May 20 15:38:46.635761 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:46.635616    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates podName:0ae0b3a6-c5ce-4509-bc25-b435f97f068d nodeName:}" failed. No retries permitted until 2026-05-20 15:38:48.635595681 +0000 UTC m=+376.687275317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates") pod "keda-metrics-apiserver-7c9f485588-xsm4q" (UID: "0ae0b3a6-c5ce-4509-bc25-b435f97f068d") : references non-existent secret key: tls.crt
May 20 15:38:46.811389 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:46.811353    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-q9cjw" event={"ID":"73d563b2-64ce-416f-a036-59c729bda3c6","Type":"ContainerStarted","Data":"e1bad18af74468bdf1629fff89419b9f9c8962a88b27d97b8a6a7502919953d3"}
May 20 15:38:48.448812 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:48.448774    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:48.449255 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.448933    2559 secret.go:281] references non-existent secret key: ca.crt
May 20 15:38:48.449255 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.448954    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
May 20 15:38:48.449255 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.448964    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-5b26c: references non-existent secret key: ca.crt
May 20 15:38:48.449255 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.449020    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates podName:c59019b7-5e5d-4887-ac6a-3815df42d1a3 nodeName:}" failed. No retries permitted until 2026-05-20 15:38:52.449003727 +0000 UTC m=+380.500683162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates") pod "keda-operator-ffbb595cb-5b26c" (UID: "c59019b7-5e5d-4887-ac6a-3815df42d1a3") : references non-existent secret key: ca.crt
May 20 15:38:48.650026 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:48.649977    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:48.650210 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.650122    2559 secret.go:281] references non-existent secret key: tls.crt
May 20 15:38:48.650210 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.650142    2559 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:38:48.650210 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.650161    2559 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q: references non-existent secret key: tls.crt
May 20 15:38:48.650313 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:38:48.650215    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates podName:0ae0b3a6-c5ce-4509-bc25-b435f97f068d nodeName:}" failed. No retries permitted until 2026-05-20 15:38:52.650200102 +0000 UTC m=+380.701879537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates") pod "keda-metrics-apiserver-7c9f485588-xsm4q" (UID: "0ae0b3a6-c5ce-4509-bc25-b435f97f068d") : references non-existent secret key: tls.crt
May 20 15:38:48.820305 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:48.820263    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-q9cjw" event={"ID":"73d563b2-64ce-416f-a036-59c729bda3c6","Type":"ContainerStarted","Data":"a0a8e1a1cd7515f412bf2e6421425855fcb23140601f07bbcb844185e9e18a47"}
May 20 15:38:48.820486 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:48.820432    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:38:48.839689 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:48.839635    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-q9cjw" podStartSLOduration=2.185285619 podStartE2EDuration="3.839620973s" podCreationTimestamp="2026-05-20 15:38:45 +0000 UTC" firstStartedPulling="2026-05-20 15:38:46.348106365 +0000 UTC m=+374.399785812" lastFinishedPulling="2026-05-20 15:38:48.002441731 +0000 UTC m=+376.054121166" observedRunningTime="2026-05-20 15:38:48.838418975 +0000 UTC m=+376.890098433" watchObservedRunningTime="2026-05-20 15:38:48.839620973 +0000 UTC m=+376.891300429"
May 20 15:38:52.487089 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.487052    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:52.489735 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.489709    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c59019b7-5e5d-4887-ac6a-3815df42d1a3-certificates\") pod \"keda-operator-ffbb595cb-5b26c\" (UID: \"c59019b7-5e5d-4887-ac6a-3815df42d1a3\") " pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:52.553351 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.553309    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:52.688163 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.687961    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-5b26c"]
May 20 15:38:52.689409 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.689383    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:52.691029 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:38:52.690999    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59019b7_5e5d_4887_ac6a_3815df42d1a3.slice/crio-6312849c9145d86986e79c071c2201f8844f002cc509def0c1a1f4e62a2e688b WatchSource:0}: Error finding container 6312849c9145d86986e79c071c2201f8844f002cc509def0c1a1f4e62a2e688b: Status 404 returned error can't find the container with id 6312849c9145d86986e79c071c2201f8844f002cc509def0c1a1f4e62a2e688b
May 20 15:38:52.692073 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.692044    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0ae0b3a6-c5ce-4509-bc25-b435f97f068d-certificates\") pod \"keda-metrics-apiserver-7c9f485588-xsm4q\" (UID: \"0ae0b3a6-c5ce-4509-bc25-b435f97f068d\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:52.828370 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.828319    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:52.837207 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.837172    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-5b26c" event={"ID":"c59019b7-5e5d-4887-ac6a-3815df42d1a3","Type":"ContainerStarted","Data":"6312849c9145d86986e79c071c2201f8844f002cc509def0c1a1f4e62a2e688b"}
May 20 15:38:52.958312 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:52.958275    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"]
May 20 15:38:52.961102 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:38:52.961071    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae0b3a6_c5ce_4509_bc25_b435f97f068d.slice/crio-1fae1f9e9dde828efebb7f54a5e7fbb5a3342d0b68c63a46c907b81a807bb338 WatchSource:0}: Error finding container 1fae1f9e9dde828efebb7f54a5e7fbb5a3342d0b68c63a46c907b81a807bb338: Status 404 returned error can't find the container with id 1fae1f9e9dde828efebb7f54a5e7fbb5a3342d0b68c63a46c907b81a807bb338
May 20 15:38:53.842809 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:53.842763    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q" event={"ID":"0ae0b3a6-c5ce-4509-bc25-b435f97f068d","Type":"ContainerStarted","Data":"1fae1f9e9dde828efebb7f54a5e7fbb5a3342d0b68c63a46c907b81a807bb338"}
May 20 15:38:56.855635 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.855538    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-5b26c" event={"ID":"c59019b7-5e5d-4887-ac6a-3815df42d1a3","Type":"ContainerStarted","Data":"fbca5715b55a8a2c148159c35b0d5275a012efb84edee79852860b5cd70428ad"}
May 20 15:38:56.856112 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.855742    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:38:56.857023 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.856988    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q" event={"ID":"0ae0b3a6-c5ce-4509-bc25-b435f97f068d","Type":"ContainerStarted","Data":"42fb3d057fcfd61bc4895b863cad1a58638687d15ea7a3aba0cde5532ff03ae0"}
May 20 15:38:56.857125 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.857099    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:38:56.874584 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.874520    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-5b26c" podStartSLOduration=8.97155617 podStartE2EDuration="12.874503872s" podCreationTimestamp="2026-05-20 15:38:44 +0000 UTC" firstStartedPulling="2026-05-20 15:38:52.692374181 +0000 UTC m=+380.744053617" lastFinishedPulling="2026-05-20 15:38:56.595321874 +0000 UTC m=+384.647001319" observedRunningTime="2026-05-20 15:38:56.873487692 +0000 UTC m=+384.925167153" watchObservedRunningTime="2026-05-20 15:38:56.874503872 +0000 UTC m=+384.926183329"
May 20 15:38:56.891731 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:38:56.891677    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q" podStartSLOduration=9.263754501 podStartE2EDuration="12.891660755s" podCreationTimestamp="2026-05-20 15:38:44 +0000 UTC" firstStartedPulling="2026-05-20 15:38:52.962406468 +0000 UTC m=+381.014085903" lastFinishedPulling="2026-05-20 15:38:56.590312708 +0000 UTC m=+384.641992157" observedRunningTime="2026-05-20 15:38:56.890418837 +0000 UTC m=+384.942098295" watchObservedRunningTime="2026-05-20 15:38:56.891660755 +0000 UTC m=+384.943340213"
May 20 15:39:05.809407 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:05.809371    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-ch5d9"
May 20 15:39:07.864990 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:07.864956    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-xsm4q"
May 20 15:39:09.825871 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:09.825843    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-q9cjw"
May 20 15:39:17.862675 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:17.862616    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-5b26c"
May 20 15:39:49.338696 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.338659    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:39:49.344119 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.344097    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.347521 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.347498    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 20 15:39:49.347661 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.347601    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jbgmq\""
May 20 15:39:49.348656 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.348639    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 20 15:39:49.348656 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.348655    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 20 15:39:49.356583 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.356557    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:39:49.376614 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.376579    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.376779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.376652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgzt\" (UniqueName: \"kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.397625 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.397591    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-jm99f"]
May 20 15:39:49.399919 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.399901    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.403261 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.403242    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 20 15:39:49.403416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.403401    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mzpqf\""
May 20 15:39:49.414255 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.414226    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-jm99f"]
May 20 15:39:49.477311 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.477276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw2b6\" (UniqueName: \"kubernetes.io/projected/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-kube-api-access-xw2b6\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.477538 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.477323    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgzt\" (UniqueName: \"kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.477538 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.477411    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.477538 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.477477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-data\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.479899 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.479872    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.486410 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.486375    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgzt\" (UniqueName: \"kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt\") pod \"kserve-controller-manager-87b4b9896-rh6kw\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") " pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.578609 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.578568    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-data\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.578779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.578637    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw2b6\" (UniqueName: \"kubernetes.io/projected/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-kube-api-access-xw2b6\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.579067 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.579045    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-data\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.589685 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.589607    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw2b6\" (UniqueName: \"kubernetes.io/projected/7dfc4dc2-f4ad-4ef1-8b04-780f0572f035-kube-api-access-xw2b6\") pod \"seaweedfs-79f457656b-jm99f\" (UID: \"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035\") " pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.655528 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.655491    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:49.709632 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.709606    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:49.810053 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.807359    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:39:49.810216 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:39:49.810149    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494c8901_58e7_458d_8d88_04058acdc533.slice/crio-bb9826dba6a997c04788ab30d82c094ff0e00e57d7942e276f15f01a881c00f7 WatchSource:0}: Error finding container bb9826dba6a997c04788ab30d82c094ff0e00e57d7942e276f15f01a881c00f7: Status 404 returned error can't find the container with id bb9826dba6a997c04788ab30d82c094ff0e00e57d7942e276f15f01a881c00f7
May 20 15:39:49.854397 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:49.854292    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-jm99f"]
May 20 15:39:49.857033 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:39:49.857003    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfc4dc2_f4ad_4ef1_8b04_780f0572f035.slice/crio-5d7de8ede894a7434e6f4dd5a128bcc16092a8c777940e311d04da70be301304 WatchSource:0}: Error finding container 5d7de8ede894a7434e6f4dd5a128bcc16092a8c777940e311d04da70be301304: Status 404 returned error can't find the container with id 5d7de8ede894a7434e6f4dd5a128bcc16092a8c777940e311d04da70be301304
May 20 15:39:50.048456 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:50.048413    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" event={"ID":"494c8901-58e7-458d-8d88-04058acdc533","Type":"ContainerStarted","Data":"bb9826dba6a997c04788ab30d82c094ff0e00e57d7942e276f15f01a881c00f7"}
May 20 15:39:50.049426 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:50.049399    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-jm99f" event={"ID":"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035","Type":"ContainerStarted","Data":"5d7de8ede894a7434e6f4dd5a128bcc16092a8c777940e311d04da70be301304"}
May 20 15:39:54.064881 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.064821    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-jm99f" event={"ID":"7dfc4dc2-f4ad-4ef1-8b04-780f0572f035","Type":"ContainerStarted","Data":"13502aa250176517d15efbd969c5b97f58ee0cf768eff41f70ff89c28426f0a4"}
May 20 15:39:54.065353 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.065009    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:39:54.066380 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.066359    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" event={"ID":"494c8901-58e7-458d-8d88-04058acdc533","Type":"ContainerStarted","Data":"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"}
May 20 15:39:54.066522 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.066506    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:39:54.083920 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.083862    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-jm99f" podStartSLOduration=1.381594516 podStartE2EDuration="5.083848654s" podCreationTimestamp="2026-05-20 15:39:49 +0000 UTC" firstStartedPulling="2026-05-20 15:39:49.858372501 +0000 UTC m=+437.910051938" lastFinishedPulling="2026-05-20 15:39:53.56062664 +0000 UTC m=+441.612306076" observedRunningTime="2026-05-20 15:39:54.081770632 +0000 UTC m=+442.133450086" watchObservedRunningTime="2026-05-20 15:39:54.083848654 +0000 UTC m=+442.135528110"
May 20 15:39:54.099733 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:39:54.099675    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" podStartSLOduration=1.6103309430000001 podStartE2EDuration="5.099658691s" podCreationTimestamp="2026-05-20 15:39:49 +0000 UTC" firstStartedPulling="2026-05-20 15:39:49.815004326 +0000 UTC m=+437.866683767" lastFinishedPulling="2026-05-20 15:39:53.304332068 +0000 UTC m=+441.356011515" observedRunningTime="2026-05-20 15:39:54.097235679 +0000 UTC m=+442.148915137" watchObservedRunningTime="2026-05-20 15:39:54.099658691 +0000 UTC m=+442.151338148"
May 20 15:40:00.072148 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:00.072118    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-jm99f"
May 20 15:40:25.075007 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.074974    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:40:25.371227 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.371141    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:40:25.371423 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.371376    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" podUID="494c8901-58e7-458d-8d88-04058acdc533" containerName="manager" containerID="cri-o://4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c" gracePeriod=10
May 20 15:40:25.400959 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.400921    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-9mgfm"]
May 20 15:40:25.404179 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.404159    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.414572 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.414536    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-9mgfm"]
May 20 15:40:25.586927 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.586886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55208b6d-6e3e-4b77-8852-415f41c66601-cert\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.587107 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.587013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkbj\" (UniqueName: \"kubernetes.io/projected/55208b6d-6e3e-4b77-8852-415f41c66601-kube-api-access-8pkbj\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.613201 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.613178    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:40:25.688552 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.688445    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkbj\" (UniqueName: \"kubernetes.io/projected/55208b6d-6e3e-4b77-8852-415f41c66601-kube-api-access-8pkbj\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.688552 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.688499    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55208b6d-6e3e-4b77-8852-415f41c66601-cert\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.691257 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.691226    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55208b6d-6e3e-4b77-8852-415f41c66601-cert\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.698179 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.698152    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkbj\" (UniqueName: \"kubernetes.io/projected/55208b6d-6e3e-4b77-8852-415f41c66601-kube-api-access-8pkbj\") pod \"kserve-controller-manager-87b4b9896-9mgfm\" (UID: \"55208b6d-6e3e-4b77-8852-415f41c66601\") " pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.754950 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.754894    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:25.789879 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.789810    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pgzt\" (UniqueName: \"kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt\") pod \"494c8901-58e7-458d-8d88-04058acdc533\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") "
May 20 15:40:25.790033 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.789914    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert\") pod \"494c8901-58e7-458d-8d88-04058acdc533\" (UID: \"494c8901-58e7-458d-8d88-04058acdc533\") "
May 20 15:40:25.792878 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.792848    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert" (OuterVolumeSpecName: "cert") pod "494c8901-58e7-458d-8d88-04058acdc533" (UID: "494c8901-58e7-458d-8d88-04058acdc533"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 15:40:25.793007 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.792913    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt" (OuterVolumeSpecName: "kube-api-access-6pgzt") pod "494c8901-58e7-458d-8d88-04058acdc533" (UID: "494c8901-58e7-458d-8d88-04058acdc533"). InnerVolumeSpecName "kube-api-access-6pgzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:40:25.889639 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.889610    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-9mgfm"]
May 20 15:40:25.890768 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.890750    2559 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494c8901-58e7-458d-8d88-04058acdc533-cert\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:40:25.890817 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:25.890772    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pgzt\" (UniqueName: \"kubernetes.io/projected/494c8901-58e7-458d-8d88-04058acdc533-kube-api-access-6pgzt\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:40:25.892242 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:40:25.892219    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55208b6d_6e3e_4b77_8852_415f41c66601.slice/crio-5bc77cd6f9c0461aaf76f0fdc9565931921d6932491db66007abf3dadf5449c6 WatchSource:0}: Error finding container 5bc77cd6f9c0461aaf76f0fdc9565931921d6932491db66007abf3dadf5449c6: Status 404 returned error can't find the container with id 5bc77cd6f9c0461aaf76f0fdc9565931921d6932491db66007abf3dadf5449c6
May 20 15:40:26.179987 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.179947    2559 generic.go:358] "Generic (PLEG): container finished" podID="494c8901-58e7-458d-8d88-04058acdc533" containerID="4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c" exitCode=0
May 20 15:40:26.180420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.180019    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw"
May 20 15:40:26.180420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.180024    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" event={"ID":"494c8901-58e7-458d-8d88-04058acdc533","Type":"ContainerDied","Data":"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"}
May 20 15:40:26.180420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.180057    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-rh6kw" event={"ID":"494c8901-58e7-458d-8d88-04058acdc533","Type":"ContainerDied","Data":"bb9826dba6a997c04788ab30d82c094ff0e00e57d7942e276f15f01a881c00f7"}
May 20 15:40:26.180420 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.180073    2559 scope.go:117] "RemoveContainer" containerID="4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"
May 20 15:40:26.181212 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.181184    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm" event={"ID":"55208b6d-6e3e-4b77-8852-415f41c66601","Type":"ContainerStarted","Data":"5bc77cd6f9c0461aaf76f0fdc9565931921d6932491db66007abf3dadf5449c6"}
May 20 15:40:26.188473 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.188453    2559 scope.go:117] "RemoveContainer" containerID="4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"
May 20 15:40:26.188792 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:40:26.188774    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c\": container with ID starting with 4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c not found: ID does not exist" containerID="4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"
May 20 15:40:26.188895 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.188797    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c"} err="failed to get container status \"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c\": rpc error: code = NotFound desc = could not find container \"4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c\": container with ID starting with 4bf1289ac0448e6d9b63b573848429fd92daead07cc7da4146986d493a412c1c not found: ID does not exist"
May 20 15:40:26.204295 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.204262    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:40:26.209006 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.208981    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-87b4b9896-rh6kw"]
May 20 15:40:26.566841 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:26.566803    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494c8901-58e7-458d-8d88-04058acdc533" path="/var/lib/kubelet/pods/494c8901-58e7-458d-8d88-04058acdc533/volumes"
May 20 15:40:27.187160 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:27.187121    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm" event={"ID":"55208b6d-6e3e-4b77-8852-415f41c66601","Type":"ContainerStarted","Data":"1d7a61e0372dd4b4bcc83de833f1ec1636f2f4ddefb239bb263392820212e0ee"}
May 20 15:40:27.187619 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:27.187184    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:27.205266 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:27.205214    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm" podStartSLOduration=1.631242427 podStartE2EDuration="2.205199438s" podCreationTimestamp="2026-05-20 15:40:25 +0000 UTC" firstStartedPulling="2026-05-20 15:40:25.893630359 +0000 UTC m=+473.945309794" lastFinishedPulling="2026-05-20 15:40:26.467587367 +0000 UTC m=+474.519266805" observedRunningTime="2026-05-20 15:40:27.203552187 +0000 UTC m=+475.255231648" watchObservedRunningTime="2026-05-20 15:40:27.205199438 +0000 UTC m=+475.256878946"
May 20 15:40:58.196097 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:58.196059    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-87b4b9896-9mgfm"
May 20 15:40:59.229446 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.229407    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-x955g"]
May 20 15:40:59.229863 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.229822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494c8901-58e7-458d-8d88-04058acdc533" containerName="manager"
May 20 15:40:59.229863 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.229851    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="494c8901-58e7-458d-8d88-04058acdc533" containerName="manager"
May 20 15:40:59.229944 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.229927    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="494c8901-58e7-458d-8d88-04058acdc533" containerName="manager"
May 20 15:40:59.233069 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.233045    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.235868 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.235822    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
May 20 15:40:59.236022 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.235909    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-899v6\""
May 20 15:40:59.252613 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.252582    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-x955g"]
May 20 15:40:59.259867 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.259819    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-696fc77849-x64lq"]
May 20 15:40:59.263704 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.263672    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.266690 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.266668    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
May 20 15:40:59.266851 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.266779    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-kqnh4\""
May 20 15:40:59.274588 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.274564    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-x64lq"]
May 20 15:40:59.377050 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.377008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vss2f\" (UniqueName: \"kubernetes.io/projected/da7ff367-6aba-48a5-b5ba-798864b9afde-kube-api-access-vss2f\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.377237 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.377083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.377237 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.377100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66r8\" (UniqueName: \"kubernetes.io/projected/c6a311ee-c14b-41a2-86ba-188eb599beb5-kube-api-access-b66r8\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.377237 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.377140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da7ff367-6aba-48a5-b5ba-798864b9afde-tls-certs\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.478459 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.478415    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.478459 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.478461    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b66r8\" (UniqueName: \"kubernetes.io/projected/c6a311ee-c14b-41a2-86ba-188eb599beb5-kube-api-access-b66r8\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.478725 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.478526    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da7ff367-6aba-48a5-b5ba-798864b9afde-tls-certs\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.478725 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.478551    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vss2f\" (UniqueName: \"kubernetes.io/projected/da7ff367-6aba-48a5-b5ba-798864b9afde-kube-api-access-vss2f\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.478725 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:40:59.478563    2559 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 20 15:40:59.478725 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:40:59.478639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert podName:c6a311ee-c14b-41a2-86ba-188eb599beb5 nodeName:}" failed. No retries permitted until 2026-05-20 15:40:59.978622861 +0000 UTC m=+508.030302295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert") pod "odh-model-controller-696fc77849-x64lq" (UID: "c6a311ee-c14b-41a2-86ba-188eb599beb5") : secret "odh-model-controller-webhook-cert" not found
May 20 15:40:59.480986 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.480938    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da7ff367-6aba-48a5-b5ba-798864b9afde-tls-certs\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.490327 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.490297    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vss2f\" (UniqueName: \"kubernetes.io/projected/da7ff367-6aba-48a5-b5ba-798864b9afde-kube-api-access-vss2f\") pod \"model-serving-api-86f7b4b499-x955g\" (UID: \"da7ff367-6aba-48a5-b5ba-798864b9afde\") " pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.490482 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.490301    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66r8\" (UniqueName: \"kubernetes.io/projected/c6a311ee-c14b-41a2-86ba-188eb599beb5-kube-api-access-b66r8\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.544653 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.544620    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:40:59.678020 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.677991    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-x955g"]
May 20 15:40:59.680251 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:40:59.680222    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7ff367_6aba_48a5_b5ba_798864b9afde.slice/crio-2b10425430969cda7e86443b66100b01fa41b50d3738f7d6d700eda99117f686 WatchSource:0}: Error finding container 2b10425430969cda7e86443b66100b01fa41b50d3738f7d6d700eda99117f686: Status 404 returned error can't find the container with id 2b10425430969cda7e86443b66100b01fa41b50d3738f7d6d700eda99117f686
May 20 15:40:59.982597 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.982559    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:40:59.984993 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:40:59.984972    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6a311ee-c14b-41a2-86ba-188eb599beb5-cert\") pod \"odh-model-controller-696fc77849-x64lq\" (UID: \"c6a311ee-c14b-41a2-86ba-188eb599beb5\") " pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:41:00.176280 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:00.176242    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:41:00.310736 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:00.310687    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-x955g" event={"ID":"da7ff367-6aba-48a5-b5ba-798864b9afde","Type":"ContainerStarted","Data":"2b10425430969cda7e86443b66100b01fa41b50d3738f7d6d700eda99117f686"}
May 20 15:41:00.326708 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:00.326531    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-x64lq"]
May 20 15:41:00.329742 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:41:00.329710    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a311ee_c14b_41a2_86ba_188eb599beb5.slice/crio-ef19727680755c603c9b4b0e9baf0ca74a2733a4941fd8195772b8fc30b3b67f WatchSource:0}: Error finding container ef19727680755c603c9b4b0e9baf0ca74a2733a4941fd8195772b8fc30b3b67f: Status 404 returned error can't find the container with id ef19727680755c603c9b4b0e9baf0ca74a2733a4941fd8195772b8fc30b3b67f
May 20 15:41:01.317149 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:01.317108    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-x64lq" event={"ID":"c6a311ee-c14b-41a2-86ba-188eb599beb5","Type":"ContainerStarted","Data":"ef19727680755c603c9b4b0e9baf0ca74a2733a4941fd8195772b8fc30b3b67f"}
May 20 15:41:04.329262 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.329228    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-x64lq" event={"ID":"c6a311ee-c14b-41a2-86ba-188eb599beb5","Type":"ContainerStarted","Data":"decc1baa466f96e2ab28f1c9d147d269d21f7412d74ba39d4e1a706faf7d498a"}
May 20 15:41:04.329711 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.329300    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:41:04.330783 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.330758    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-x955g" event={"ID":"da7ff367-6aba-48a5-b5ba-798864b9afde","Type":"ContainerStarted","Data":"cddb92985688b3ba9657d5ea2755f545926dee37d5f6137d8d113b96d9d65e69"}
May 20 15:41:04.330892 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.330865    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:41:04.350530 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.350466    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/odh-model-controller-696fc77849-x64lq" podStartSLOduration=2.213678154 podStartE2EDuration="5.350449203s" podCreationTimestamp="2026-05-20 15:40:59 +0000 UTC" firstStartedPulling="2026-05-20 15:41:00.331458743 +0000 UTC m=+508.383138177" lastFinishedPulling="2026-05-20 15:41:03.468229785 +0000 UTC m=+511.519909226" observedRunningTime="2026-05-20 15:41:04.349909076 +0000 UTC m=+512.401588534" watchObservedRunningTime="2026-05-20 15:41:04.350449203 +0000 UTC m=+512.402128661"
May 20 15:41:04.368383 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:04.368332    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-x955g" podStartSLOduration=1.587540988 podStartE2EDuration="5.368312912s" podCreationTimestamp="2026-05-20 15:40:59 +0000 UTC" firstStartedPulling="2026-05-20 15:40:59.681818302 +0000 UTC m=+507.733497737" lastFinishedPulling="2026-05-20 15:41:03.462590226 +0000 UTC m=+511.514269661" observedRunningTime="2026-05-20 15:41:04.367424024 +0000 UTC m=+512.419103485" watchObservedRunningTime="2026-05-20 15:41:04.368312912 +0000 UTC m=+512.419992371"
May 20 15:41:15.336283 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:15.336253    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-696fc77849-x64lq"
May 20 15:41:15.338287 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:15.338265    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-x955g"
May 20 15:41:27.789345 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.789261    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:27.794621 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.794596    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.797072 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.797049    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
May 20 15:41:27.801177 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.801143    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:27.814064 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.814028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.814255 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.814134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmr5\" (UniqueName: \"kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.915311 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.915265    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmr5\" (UniqueName: \"kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.915473 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.915360    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.915694 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.915678    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:27.924869 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:27.924816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmr5\" (UniqueName: \"kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5\") pod \"seaweedfs-tls-custom-ddd4dbfd-mcnwq\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") " pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:28.104918 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:28.104808    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:28.237954 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:28.237920    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:28.241144 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:41:28.241113    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b29f02e_e0a0_4f1d_ab0d_70822069fac4.slice/crio-0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185 WatchSource:0}: Error finding container 0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185: Status 404 returned error can't find the container with id 0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185
May 20 15:41:28.411015 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:28.410930    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" event={"ID":"4b29f02e-e0a0-4f1d-ab0d-70822069fac4","Type":"ContainerStarted","Data":"0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185"}
May 20 15:41:29.416124 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:29.416080    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" event={"ID":"4b29f02e-e0a0-4f1d-ab0d-70822069fac4","Type":"ContainerStarted","Data":"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"}
May 20 15:41:29.434504 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:29.434454    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" podStartSLOduration=2.076431033 podStartE2EDuration="2.434440947s" podCreationTimestamp="2026-05-20 15:41:27 +0000 UTC" firstStartedPulling="2026-05-20 15:41:28.242433905 +0000 UTC m=+536.294113341" lastFinishedPulling="2026-05-20 15:41:28.600443817 +0000 UTC m=+536.652123255" observedRunningTime="2026-05-20 15:41:29.432511723 +0000 UTC m=+537.484191171" watchObservedRunningTime="2026-05-20 15:41:29.434440947 +0000 UTC m=+537.486120404"
May 20 15:41:30.778669 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:30.778631    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:31.422105 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:31.422031    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" podUID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" containerName="seaweedfs-tls-custom" containerID="cri-o://393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641" gracePeriod=30
May 20 15:41:59.151167 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:41:59.151114    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b29f02e_e0a0_4f1d_ab0d_70822069fac4.slice/crio-0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185\": RecentStats: unable to find data in memory cache]"
May 20 15:41:59.293377 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.293346    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:59.389054 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.388965    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftmr5\" (UniqueName: \"kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5\") pod \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") "
May 20 15:41:59.389054 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.389016    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data\") pod \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\" (UID: \"4b29f02e-e0a0-4f1d-ab0d-70822069fac4\") "
May 20 15:41:59.390457 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.390428    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data" (OuterVolumeSpecName: "data") pod "4b29f02e-e0a0-4f1d-ab0d-70822069fac4" (UID: "4b29f02e-e0a0-4f1d-ab0d-70822069fac4"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:41:59.391133 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.391109    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5" (OuterVolumeSpecName: "kube-api-access-ftmr5") pod "4b29f02e-e0a0-4f1d-ab0d-70822069fac4" (UID: "4b29f02e-e0a0-4f1d-ab0d-70822069fac4"). InnerVolumeSpecName "kube-api-access-ftmr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:41:59.489779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.489734    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftmr5\" (UniqueName: \"kubernetes.io/projected/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-kube-api-access-ftmr5\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:41:59.489779 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.489772    2559 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b29f02e-e0a0-4f1d-ab0d-70822069fac4-data\") on node \"ip-10-0-135-93.ec2.internal\" DevicePath \"\""
May 20 15:41:59.522660 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.522630    2559 generic.go:358] "Generic (PLEG): container finished" podID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" containerID="393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641" exitCode=0
May 20 15:41:59.522823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.522688    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"
May 20 15:41:59.522823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.522723    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" event={"ID":"4b29f02e-e0a0-4f1d-ab0d-70822069fac4","Type":"ContainerDied","Data":"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"}
May 20 15:41:59.522823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.522760    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq" event={"ID":"4b29f02e-e0a0-4f1d-ab0d-70822069fac4","Type":"ContainerDied","Data":"0c1e7244dbb3047ebf6c088ed3e9cf71634dd1128d1af262d67a849790f99185"}
May 20 15:41:59.522823 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.522777    2559 scope.go:117] "RemoveContainer" containerID="393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"
May 20 15:41:59.532503 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.532484    2559 scope.go:117] "RemoveContainer" containerID="393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"
May 20 15:41:59.532797 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:41:59.532777    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641\": container with ID starting with 393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641 not found: ID does not exist" containerID="393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"
May 20 15:41:59.532871 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.532809    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641"} err="failed to get container status \"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641\": rpc error: code = NotFound desc = could not find container \"393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641\": container with ID starting with 393a956c8b68433b93af100313cf10058a62a365ef822e6f699ac57dc94a6641 not found: ID does not exist"
May 20 15:41:59.545416 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.545385    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:59.550038 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.550009    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-ddd4dbfd-mcnwq"]
May 20 15:41:59.603134 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.603090    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"]
May 20 15:41:59.603569 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.603554    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" containerName="seaweedfs-tls-custom"
May 20 15:41:59.603617 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.603571    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" containerName="seaweedfs-tls-custom"
May 20 15:41:59.603665 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.603656    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" containerName="seaweedfs-tls-custom"
May 20 15:41:59.608597 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.608568    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.610362 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.610336    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"]
May 20 15:41:59.621054 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.621032    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\""
May 20 15:41:59.621303 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.621285    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
May 20 15:41:59.691810 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.691722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.692015 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.691910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.692015 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.691996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rb4\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-kube-api-access-t8rb4\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.792595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.792554    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.792595 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.792599    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rb4\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-kube-api-access-t8rb4\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.792876 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.792628    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.793070 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.793044    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.795065 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.795039    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.802666 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.802636    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rb4\" (UniqueName: \"kubernetes.io/projected/96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95-kube-api-access-t8rb4\") pod \"seaweedfs-tls-custom-5c88b85bb7-9k6nk\" (UID: \"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:41:59.918915 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:41:59.918864    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"
May 20 15:42:00.050782 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:00.050745    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk"]
May 20 15:42:00.053784 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:42:00.053758    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a07b8f_7309_4a2b_8bcc_1e1d0ec38c95.slice/crio-9f1d2a8daad60b1ab30fa03529d11f8091fb652f91b90b1b47477a421ea74051 WatchSource:0}: Error finding container 9f1d2a8daad60b1ab30fa03529d11f8091fb652f91b90b1b47477a421ea74051: Status 404 returned error can't find the container with id 9f1d2a8daad60b1ab30fa03529d11f8091fb652f91b90b1b47477a421ea74051
May 20 15:42:00.528681 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:00.528646    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk" event={"ID":"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95","Type":"ContainerStarted","Data":"01b8fc1b06655604e963b5c1f13c6f0fcd207a1a00376c7ce53c1c9cd25a513f"}
May 20 15:42:00.528681 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:00.528681    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk" event={"ID":"96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95","Type":"ContainerStarted","Data":"9f1d2a8daad60b1ab30fa03529d11f8091fb652f91b90b1b47477a421ea74051"}
May 20 15:42:00.552385 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:00.552327    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-9k6nk" podStartSLOduration=1.268680861 podStartE2EDuration="1.552311114s" podCreationTimestamp="2026-05-20 15:41:59 +0000 UTC" firstStartedPulling="2026-05-20 15:42:00.055114596 +0000 UTC m=+568.106794035" lastFinishedPulling="2026-05-20 15:42:00.338744851 +0000 UTC m=+568.390424288" observedRunningTime="2026-05-20 15:42:00.55117717 +0000 UTC m=+568.602856655" watchObservedRunningTime="2026-05-20 15:42:00.552311114 +0000 UTC m=+568.603990571"
May 20 15:42:00.565160 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:00.565126    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b29f02e-e0a0-4f1d-ab0d-70822069fac4" path="/var/lib/kubelet/pods/4b29f02e-e0a0-4f1d-ab0d-70822069fac4/volumes"
May 20 15:42:09.817113 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.817076    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-mq554"]
May 20 15:42:09.820525 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.820504    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:09.823106 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.823087    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\""
May 20 15:42:09.823200 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.823132    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
May 20 15:42:09.834135 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.834104    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-mq554"]
May 20 15:42:09.978263 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.978220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:09.978453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.978275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a922832-c3a5-4279-a689-7346c00efaa2-data\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:09.978453 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:09.978294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8vd\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-kube-api-access-wp8vd\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.079260 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.079159    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.079260 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.079213    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a922832-c3a5-4279-a689-7346c00efaa2-data\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.079498 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.079328    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8vd\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-kube-api-access-wp8vd\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.079498 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:42:10.079326    2559 projected.go:264] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found
May 20 15:42:10.079498 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:42:10.079397    2559 projected.go:194] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-7fd5766db9-mq554: secret "seaweedfs-tls-serving" not found
May 20 15:42:10.079498 ip-10-0-135-93 kubenswrapper[2559]: E0520 15:42:10.079449    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving podName:9a922832-c3a5-4279-a689-7346c00efaa2 nodeName:}" failed. No retries permitted until 2026-05-20 15:42:10.579430507 +0000 UTC m=+578.631109942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-7fd5766db9-mq554" (UID: "9a922832-c3a5-4279-a689-7346c00efaa2") : secret "seaweedfs-tls-serving" not found
May 20 15:42:10.079692 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.079542    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a922832-c3a5-4279-a689-7346c00efaa2-data\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.089722 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.089686    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8vd\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-kube-api-access-wp8vd\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.583908 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.583868    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.586250 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.586222    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9a922832-c3a5-4279-a689-7346c00efaa2-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-7fd5766db9-mq554\" (UID: \"9a922832-c3a5-4279-a689-7346c00efaa2\") " pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.729572 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.729539    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554"
May 20 15:42:10.868305 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:10.868278    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-7fd5766db9-mq554"]
May 20 15:42:10.870674 ip-10-0-135-93 kubenswrapper[2559]: W0520 15:42:10.870646    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a922832_c3a5_4279_a689_7346c00efaa2.slice/crio-006057c970bceb80bf193ae0cb567a824c69fddcee7c256613523080f23d98b4 WatchSource:0}: Error finding container 006057c970bceb80bf193ae0cb567a824c69fddcee7c256613523080f23d98b4: Status 404 returned error can't find the container with id 006057c970bceb80bf193ae0cb567a824c69fddcee7c256613523080f23d98b4
May 20 15:42:11.566123 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:11.566082    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554" event={"ID":"9a922832-c3a5-4279-a689-7346c00efaa2","Type":"ContainerStarted","Data":"75ce21440601fb30988f45c0eb3f6b0591ae3de589abc149f362722ffa9b466f"}
May 20 15:42:11.566123 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:11.566121    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554" event={"ID":"9a922832-c3a5-4279-a689-7346c00efaa2","Type":"ContainerStarted","Data":"006057c970bceb80bf193ae0cb567a824c69fddcee7c256613523080f23d98b4"}
May 20 15:42:11.590642 ip-10-0-135-93 kubenswrapper[2559]: I0520 15:42:11.590583    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-7fd5766db9-mq554" podStartSLOduration=2.312939237 podStartE2EDuration="2.590566924s" podCreationTimestamp="2026-05-20 15:42:09 +0000 UTC" firstStartedPulling="2026-05-20 15:42:10.872012907 +0000 UTC m=+578.923692343" lastFinishedPulling="2026-05-20 15:42:11.149640591 +0000 UTC m=+579.201320030" observedRunningTime="2026-05-20 15:42:11.588116411 +0000 UTC m=+579.639795870" watchObservedRunningTime="2026-05-20 15:42:11.590566924 +0000 UTC m=+579.642246381"
May 20 16:37:26.660166 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:26.660138    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mnfpx_2dd5bfff-95c2-4cda-a050-e6db90ba62c6/global-pull-secret-syncer/0.log"
May 20 16:37:26.808176 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:26.808143    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kpk94_285708ba-11b4-4be0-812b-48e038f64023/konnectivity-agent/0.log"
May 20 16:37:26.930462 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:26.930375    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-93.ec2.internal_9ef9e18c43a8b05285be032dd09ab0b2/haproxy/0.log"
May 20 16:37:30.272020 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.271995    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-vt6qc_7d3b96de-681f-41be-8245-a913e6bfcc42/cluster-monitoring-operator/0.log"
May 20 16:37:30.300330 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.300297    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vr4d8_22b83d3d-4397-4ad6-83be-1d2f2a2038fd/kube-state-metrics/0.log"
May 20 16:37:30.321404 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.321379    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vr4d8_22b83d3d-4397-4ad6-83be-1d2f2a2038fd/kube-rbac-proxy-main/0.log"
May 20 16:37:30.346298 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.346265    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-vr4d8_22b83d3d-4397-4ad6-83be-1d2f2a2038fd/kube-rbac-proxy-self/0.log"
May 20 16:37:30.416499 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.416468    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-xmlff_a6015557-ebbc-4c16-bb03-37cdd9a0346d/monitoring-plugin/0.log"
May 20 16:37:30.448378 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.448350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cq7p6_72704c01-ee13-472c-88b0-37f0ebe7e71e/node-exporter/0.log"
May 20 16:37:30.468724 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.468697    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cq7p6_72704c01-ee13-472c-88b0-37f0ebe7e71e/kube-rbac-proxy/0.log"
May 20 16:37:30.494080 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.494058    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cq7p6_72704c01-ee13-472c-88b0-37f0ebe7e71e/init-textfile/0.log"
May 20 16:37:30.679405 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.679331    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gxwgm_6c0a26d9-f861-4e8f-b844-0a6e9be2b146/kube-rbac-proxy-main/0.log"
May 20 16:37:30.700976 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.700945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gxwgm_6c0a26d9-f861-4e8f-b844-0a6e9be2b146/kube-rbac-proxy-self/0.log"
May 20 16:37:30.721649 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.721617    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-gxwgm_6c0a26d9-f861-4e8f-b844-0a6e9be2b146/openshift-state-metrics/0.log"
May 20 16:37:30.999590 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:30.999515    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-gnzzp_b3e34e40-7673-4d06-b3b5-d2ca51b5070e/prometheus-operator-admission-webhook/0.log"
May 20 16:37:31.105629 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.105594    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/thanos-query/0.log"
May 20 16:37:31.128411 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.128388    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/kube-rbac-proxy-web/0.log"
May 20 16:37:31.152896 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.152869    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/kube-rbac-proxy/0.log"
May 20 16:37:31.174080 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.174059    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/prom-label-proxy/0.log"
May 20 16:37:31.197732 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.197710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/kube-rbac-proxy-rules/0.log"
May 20 16:37:31.222386 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:31.222366    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65bbdbdb8-d7rjd_76ada298-59c0-4281-84e3-bb01345b61df/kube-rbac-proxy-metrics/0.log"
May 20 16:37:32.354700 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:32.354664    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-zl44r_174ef8dd-4c22-42da-9ed3-3572ad6a0af2/networking-console-plugin/0.log"
May 20 16:37:33.185230 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.185199    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-762cj_b4d81924-0896-4439-b6f5-12fa5a14e444/download-server/0.log"
May 20 16:37:33.709651 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.709619    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"]
May 20 16:37:33.713159 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.713136    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.715604 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.715581    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwsjl\"/\"default-dockercfg-b4sdk\""
May 20 16:37:33.715715 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.715589    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwsjl\"/\"openshift-service-ca.crt\""
May 20 16:37:33.716873 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.716853    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwsjl\"/\"kube-root-ca.crt\""
May 20 16:37:33.722398 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.722370    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"]
May 20 16:37:33.795110 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.795063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nl5\" (UniqueName: \"kubernetes.io/projected/34009014-4786-4d22-9c79-ec16ebb210bc-kube-api-access-p7nl5\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.795110 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.795107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-sys\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.795315 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.795127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-proc\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.795315 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.795180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-lib-modules\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.795315 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.795237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-podres\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896385 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896344    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nl5\" (UniqueName: \"kubernetes.io/projected/34009014-4786-4d22-9c79-ec16ebb210bc-kube-api-access-p7nl5\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896385 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896388    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-sys\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896409    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-proc\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-proc\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-sys\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896507    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-lib-modules\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896546    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-podres\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896610 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896595    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-lib-modules\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.896799 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.896642    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34009014-4786-4d22-9c79-ec16ebb210bc-podres\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:33.904712 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:33.904676    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nl5\" (UniqueName: \"kubernetes.io/projected/34009014-4786-4d22-9c79-ec16ebb210bc-kube-api-access-p7nl5\") pod \"perf-node-gather-daemonset-nrkzr\" (UID: \"34009014-4786-4d22-9c79-ec16ebb210bc\") " pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:34.024927 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.024891    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:34.159417 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.159388    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"]
May 20 16:37:34.162293 ip-10-0-135-93 kubenswrapper[2559]: W0520 16:37:34.162267    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34009014_4786_4d22_9c79_ec16ebb210bc.slice/crio-64a734862b1647b90d6a2741bee5ae8a0abb839cee27a2bdf1d239d8bc240fe8 WatchSource:0}: Error finding container 64a734862b1647b90d6a2741bee5ae8a0abb839cee27a2bdf1d239d8bc240fe8: Status 404 returned error can't find the container with id 64a734862b1647b90d6a2741bee5ae8a0abb839cee27a2bdf1d239d8bc240fe8
May 20 16:37:34.163948 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.163934    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 16:37:34.343296 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.343209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dp8ml_3bc2640c-ca66-4ec8-89f5-a89ffb6ece64/dns/0.log"
May 20 16:37:34.368345 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.368314    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dp8ml_3bc2640c-ca66-4ec8-89f5-a89ffb6ece64/kube-rbac-proxy/0.log"
May 20 16:37:34.448185 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.448155    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mdr68_fa286413-633d-415f-86e3-c155eb12282e/dns-node-resolver/0.log"
May 20 16:37:34.987948 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:34.987917    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnmvl_cc112da5-ca7b-43dc-9971-ebc1d7d7c14c/node-ca/0.log"
May 20 16:37:35.038106 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:35.038073    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr" event={"ID":"34009014-4786-4d22-9c79-ec16ebb210bc","Type":"ContainerStarted","Data":"1fc93561cd38422caa4e67504c385256a65ef71778a1c1eb586f0132ec345836"}
May 20 16:37:35.038106 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:35.038111    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr" event={"ID":"34009014-4786-4d22-9c79-ec16ebb210bc","Type":"ContainerStarted","Data":"64a734862b1647b90d6a2741bee5ae8a0abb839cee27a2bdf1d239d8bc240fe8"}
May 20 16:37:35.038318 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:35.038147    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:35.055445 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:35.055400    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr" podStartSLOduration=2.055384608 podStartE2EDuration="2.055384608s" podCreationTimestamp="2026-05-20 16:37:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:37:35.053634791 +0000 UTC m=+3903.105314251" watchObservedRunningTime="2026-05-20 16:37:35.055384608 +0000 UTC m=+3903.107064064"
May 20 16:37:36.114031 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.113997    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nfv2f_54a52853-c484-4669-b435-6a08ebedd3de/serve-healthcheck-canary/0.log"
May 20 16:37:36.462218 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.462124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-h24kw_30b189fc-aada-4e0f-a585-e598e637bc92/insights-operator/0.log"
May 20 16:37:36.463259 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.463234    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-h24kw_30b189fc-aada-4e0f-a585-e598e637bc92/insights-operator/1.log"
May 20 16:37:36.547802 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.547768    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbfcd_4effab22-6999-457a-9f8e-f8ab7d0cb642/kube-rbac-proxy/0.log"
May 20 16:37:36.568168 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.568141    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbfcd_4effab22-6999-457a-9f8e-f8ab7d0cb642/exporter/0.log"
May 20 16:37:36.589139 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:36.589092    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbfcd_4effab22-6999-457a-9f8e-f8ab7d0cb642/extractor/0.log"
May 20 16:37:38.655459 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:38.655424    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-87b4b9896-9mgfm_55208b6d-6e3e-4b77-8852-415f41c66601/manager/0.log"
May 20 16:37:38.699862 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:38.699805    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-x955g_da7ff367-6aba-48a5-b5ba-798864b9afde/server/0.log"
May 20 16:37:39.120160 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:39.120124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-696fc77849-x64lq_c6a311ee-c14b-41a2-86ba-188eb599beb5/manager/0.log"
May 20 16:37:39.263385 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:39.263357    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-jm99f_7dfc4dc2-f4ad-4ef1-8b04-780f0572f035/seaweedfs/0.log"
May 20 16:37:39.289688 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:39.289656    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-5c88b85bb7-9k6nk_96a07b8f-7309-4a2b-8bcc-1e1d0ec38c95/seaweedfs-tls-custom/0.log"
May 20 16:37:39.314936 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:39.314903    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-7fd5766db9-mq554_9a922832-c3a5-4279-a689-7346c00efaa2/seaweedfs-tls-serving/0.log"
May 20 16:37:41.052115 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:41.052088    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwsjl/perf-node-gather-daemonset-nrkzr"
May 20 16:37:44.448104 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.448076    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/kube-multus-additional-cni-plugins/0.log"
May 20 16:37:44.470161 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.470130    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/egress-router-binary-copy/0.log"
May 20 16:37:44.491516 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.491411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/cni-plugins/0.log"
May 20 16:37:44.511728 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.511699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/bond-cni-plugin/0.log"
May 20 16:37:44.532962 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.532940    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/routeoverride-cni/0.log"
May 20 16:37:44.554865 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.554804    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/whereabouts-cni-bincopy/0.log"
May 20 16:37:44.575110 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.575082    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgjpt_abb53c6b-e8a4-4542-ba66-9bed7765c0f1/whereabouts-cni/0.log"
May 20 16:37:44.791737 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.791710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tzc97_181580ea-035f-4dec-bcae-eb826cdbd2ad/kube-multus/0.log"
May 20 16:37:44.902679 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.902643    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lflkp_b633256f-cf71-47cc-8224-0bb5a10ff4c6/network-metrics-daemon/0.log"
May 20 16:37:44.922907 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:44.922879    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lflkp_b633256f-cf71-47cc-8224-0bb5a10ff4c6/kube-rbac-proxy/0.log"
May 20 16:37:46.493261 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.493180    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/ovn-controller/0.log"
May 20 16:37:46.544245 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.544209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/ovn-acl-logging/0.log"
May 20 16:37:46.566925 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.566901    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/kube-rbac-proxy-node/0.log"
May 20 16:37:46.588373 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.588337    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/kube-rbac-proxy-ovn-metrics/0.log"
May 20 16:37:46.604458 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.604421    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/northd/0.log"
May 20 16:37:46.623643 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.623610    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/nbdb/0.log"
May 20 16:37:46.645120 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.645095    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/sbdb/0.log"
May 20 16:37:46.813203 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:46.813138    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmwf4_a6f1c997-0fca-4936-990f-7faa4e9f33cd/ovnkube-controller/0.log"
May 20 16:37:47.819868 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:47.819818    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-l6ddl_8298e4e3-e553-4cea-a6f1-1a50004f409e/network-check-target-container/0.log"
May 20 16:37:48.771793 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:48.771759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-x8gtc_4f5d5f98-3643-4e5f-bdb6-6e6b4d019a10/iptables-alerter/0.log"
May 20 16:37:49.366283 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:49.366249    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5pdf2_240ce8a6-a8de-4400-98cb-cb44bb63e032/tuned/0.log"
May 20 16:37:51.090650 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:51.090612    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-flp4m_28970993-18f8-4680-8202-a7790234294b/cluster-samples-operator/0.log"
May 20 16:37:51.108867 ip-10-0-135-93 kubenswrapper[2559]: I0520 16:37:51.108840    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-flp4m_28970993-18f8-4680-8202-a7790234294b/cluster-samples-operator-watch/0.log"