May 25 11:17:40.394031 ip-10-0-131-36 systemd[1]: Starting Kubernetes Kubelet...
May 25 11:17:40.920844 ip-10-0-131-36 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:40.920844 ip-10-0-131-36 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 11:17:40.920844 ip-10-0-131-36 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:40.920844 ip-10-0-131-36 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 11:17:40.920844 ip-10-0-131-36 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:17:40.923690 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.923592    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 11:17:40.930142 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930126    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:40.930142 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930142    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930146    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930150    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930154    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930157    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930160    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930169    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930172    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930175    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930178    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930181    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930184    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930186    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930189    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930191    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930194    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930197    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930200    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930203    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930205    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:40.930212 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930208    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930211    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930213    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930216    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930219    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930221    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930224    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930227    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930229    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930232    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930235    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930238    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930240    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930244    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930246    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930249    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930251    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930254    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930257    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930260    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:40.930711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930262    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930265    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930267    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930270    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930272    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930274    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930277    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930279    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930282    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930284    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930287    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930289    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930292    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930295    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930302    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930306    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930309    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930312    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930314    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:40.931217 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930317    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930320    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930322    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930325    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930328    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930332    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930334    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930337    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930340    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930345    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930348    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930351    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930354    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930357    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930360    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930363    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930365    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930368    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930371    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930375    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:40.931801 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930377    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930380    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930383    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930386    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930389    2562 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930391    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930799    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930806    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930808    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930811    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930814    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930817    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930820    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930823    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930825    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930828    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930831    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930833    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930836    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:40.932282 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930839    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930841    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930844    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930847    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930849    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930852    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930854    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930856    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930859    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930863    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930867    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930869    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930872    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930875    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930878    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930880    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930883    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930886    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930889    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:40.932749 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930894    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930897    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930899    2562 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930902    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930905    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930908    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930910    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930913    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930915    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930918    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930921    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930923    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930926    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930929    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930931    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930934    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930938    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930941    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930945    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930948    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:40.933278 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930952    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930955    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930957    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930960    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930963    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930965    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930968    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930970    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930973    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930975    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930978    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930981    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930984    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930987    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930989    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930992    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930995    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.930997    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931000    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931002    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:40.933809 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931006    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931008    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931011    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931014    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931016    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931019    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931022    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931025    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931027    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931030    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931032    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931035    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.931037    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932790    2562 flags.go:64] FLAG: --address="0.0.0.0"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932799    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932808    2562 flags.go:64] FLAG: --anonymous-auth="true"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932814    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932818    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932821    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932826    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932830    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 11:17:40.934302 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932834    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932837    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932841    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932845    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932848    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932851    2562 flags.go:64] FLAG: --cgroup-root=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932855    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932858    2562 flags.go:64] FLAG: --client-ca-file=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932861    2562 flags.go:64] FLAG: --cloud-config=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932864    2562 flags.go:64] FLAG: --cloud-provider="external"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932867    2562 flags.go:64] FLAG: --cluster-dns="[]"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932871    2562 flags.go:64] FLAG: --cluster-domain=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932874    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932877    2562 flags.go:64] FLAG: --config-dir=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932880    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932883    2562 flags.go:64] FLAG: --container-log-max-files="5"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932887    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932890    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932894    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932897    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932901    2562 flags.go:64] FLAG: --contention-profiling="false"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932904    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932907    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932910    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932913    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 11:17:40.934827 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932917    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932920    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932924    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932927    2562 flags.go:64] FLAG: --enable-load-reader="false"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932930    2562 flags.go:64] FLAG: --enable-server="true"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932933    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932938    2562 flags.go:64] FLAG: --event-burst="100"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932942    2562 flags.go:64] FLAG: --event-qps="50"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932945    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932948    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932952    2562 flags.go:64] FLAG: --eviction-hard=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932955    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932959    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932962    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932965    2562 flags.go:64] FLAG: --eviction-soft=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932968    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932971    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932974    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932977    2562 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932980    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932983    2562 flags.go:64] FLAG: --fail-swap-on="true"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932986    2562 flags.go:64] FLAG: --feature-gates=""
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932990    2562 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932993    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.932996    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 11:17:40.935428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933000    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933004    2562 flags.go:64] FLAG: --healthz-port="10248"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933007    2562 flags.go:64] FLAG: --help="false"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933010    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-36.ec2.internal"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933014    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933017    2562 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933020    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933024    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933027    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933030    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933033    2562 flags.go:64] FLAG: --image-service-endpoint=""
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933036    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933039    2562 flags.go:64] FLAG: --kube-api-burst="100"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933042    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933045    2562 flags.go:64] FLAG: --kube-api-qps="50"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933048    2562 flags.go:64] FLAG: --kube-reserved=""
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933051    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933054    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933057    2562 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933060    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933063    2562 flags.go:64] FLAG: --lock-file=""
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933066    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933069    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933072    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 11:17:40.936056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933078    2562 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933081    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933084    2562 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933087    2562 flags.go:64] FLAG: --logging-format="text"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933090    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933094    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933097    2562 flags.go:64] FLAG: --manifest-url=""
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933100    2562 flags.go:64] FLAG: --manifest-url-header=""
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933104    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933107    2562 flags.go:64] FLAG: --max-open-files="1000000"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933112    2562 flags.go:64] FLAG: --max-pods="110"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933115    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933118    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933121    2562 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933124    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933127    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933130    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933133    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933141    2562 flags.go:64] FLAG: --node-status-max-images="50"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933144    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933147    2562 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933150    2562 flags.go:64] FLAG: --pod-cidr=""
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933153    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 11:17:40.936647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933159    2562 flags.go:64] FLAG: --pod-manifest-path=""
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933162    2562 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933165    2562 flags.go:64] FLAG: --pods-per-core="0"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933168    2562 flags.go:64] FLAG: --port="10250"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933171    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933174    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0735b8125b25a5155"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933178    2562 flags.go:64] FLAG: --qos-reserved=""
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933181    2562 flags.go:64] FLAG: --read-only-port="10255"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933183    2562 flags.go:64] FLAG: --register-node="true"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933186    2562 flags.go:64] FLAG: --register-schedulable="true"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933189    2562 flags.go:64] FLAG: --register-with-taints=""
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933193    2562 flags.go:64] FLAG: --registry-burst="10"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933196    2562 flags.go:64] FLAG: --registry-qps="5"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933199    2562 flags.go:64] FLAG: --reserved-cpus=""
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933201    2562 flags.go:64] FLAG: --reserved-memory=""
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933205    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933208    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933211    2562 flags.go:64] FLAG: --rotate-certificates="false"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933214    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933217    2562 flags.go:64] FLAG: --runonce="false"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933220    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933224    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933227    2562 flags.go:64] FLAG: --seccomp-default="false"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933229    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933232    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933235    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 11:17:40.937199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933243    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933247    2562 flags.go:64] FLAG: --storage-driver-password="root"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933250    2562 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933253    2562 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933256    2562 flags.go:64] FLAG: --storage-driver-user="root"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933259    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933262    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933266    2562 flags.go:64] FLAG: --system-cgroups=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933269    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933274    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933277    2562 flags.go:64] FLAG: --tls-cert-file=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933280    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933284    2562 flags.go:64] FLAG: --tls-min-version=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933287    2562 flags.go:64] FLAG: --tls-private-key-file=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933290    2562 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933293    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933296    2562 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933299    2562 flags.go:64] FLAG: --v="2"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933309    2562 flags.go:64] FLAG: --version="false"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933313    2562 flags.go:64] FLAG: --vmodule=""
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933317    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.933320    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933414    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933423    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:40.937882 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933426    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933429    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933433    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933438    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933441    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933444    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933447    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933449    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933453    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933456    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933459    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933461    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933464    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933466    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933469    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933472    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933474    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933477    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933479    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933482    2562 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:40.938466 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933484    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933487    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933490    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933492    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933495    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933498    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933500    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933503    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933505    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933508    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933511    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933515    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933517    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933520    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933523    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933525    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933528    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933531    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933534    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:40.938993 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933536    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933540    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933543    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933546    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933548    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933551    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933553    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933556    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933558    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933561    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933581    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933585    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933588    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933591    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933593    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933596    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933598    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933601    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933603    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933606    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:40.939463 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933609    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933612    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933614    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933617    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933621    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933624    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933626    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933629    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933631    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933634    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933637    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933648    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933652    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933657    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933660    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933664    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933667    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933671    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933674    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933677    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:40.939967 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933680    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:40.940805 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933683    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:40.940805 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933686    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:40.940805 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933689    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:40.940805 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.933691    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:40.940805 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.934464    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:40.943129 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.943109    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 11:17:40.943129 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.943129    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943179    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943184    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943188    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943192    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943195    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943198    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943201    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943204    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943207    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943210    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943213    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943216    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:40.943214 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943220    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943223    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943226    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943229    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943231    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943234    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943236    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943239    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943242    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943244    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943247    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943250    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943253    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943255    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943259    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943262    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943264    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943267    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943269    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:40.943547 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943272    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943275    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943279    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943283    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943287    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943290    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943293    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943296    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943298    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943301    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943304    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943306    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943309    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943311    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943315    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943318    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943321    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943324    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943327    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:40.944023 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943330    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943333    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943335    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943338    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943342    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943346    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943348    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943351    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943354    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943357    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943359    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943362    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943364    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943367    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943370    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943372    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943375    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943377    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943380    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:40.944476 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943382    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943385    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943388    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943390    2562 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943393    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943396    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943399    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943402    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943406    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943409    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943412    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943414    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943417    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943420    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943423    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943426    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:40.944949 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943428    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.943433    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943525    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943530    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943533    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943536    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943539    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943542    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943545    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943548    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943551    2562 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943554    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943557    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943560    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943578    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943582    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:17:40.945350 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943584    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943587    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943589    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943592    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943595    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943598    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943600    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943603    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943607    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943610    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943613    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943616    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943619    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943622    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943624    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943628    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943630    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943633    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943635    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:17:40.945783 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943638    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943640    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943643    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943645    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943648    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943650    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943653    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943655    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943658    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943661    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943663    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943666    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943668    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943671    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943674    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943676    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943679    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943681    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943684    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943687    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:17:40.946239 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943690    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943692    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943696    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943699    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943701    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943704    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943707    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943710    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943713    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943716    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943718    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943721    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943723    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943726    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943728    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943731    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943734    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943736    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943739    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943741    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:17:40.946736 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943744    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943746    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943749    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943752    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943754    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943756    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943759    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943762    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943765    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943769    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943772    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943775    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:40.943778    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.943783    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:17:40.947224 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.944762    2562 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 11:17:40.948801 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.948787    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 11:17:40.949917 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.949905    2562 server.go:1019] "Starting client certificate rotation"
May 25 11:17:40.950065 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.950048    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:17:40.950097 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.950084    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:17:40.977444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.977423    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:17:40.982220 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.982200    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:17:40.999315 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:40.999294    2562 log.go:25] "Validated CRI v1 runtime API"
May 25 11:17:41.006733 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.006715    2562 log.go:25] "Validated CRI v1 image API"
May 25 11:17:41.008066 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.008052    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 11:17:41.010706 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.010685    2562 fs.go:135] Filesystem UUIDs: map[0bde89a7-d939-4ed3-a30c-568bc232218c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8a36e194-734a-408a-be43-22107f29c7c1:/dev/nvme0n1p4]
May 25 11:17:41.010785 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.010704    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 11:17:41.011973 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.011957    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:17:41.015091 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.014985    2562 manager.go:217] Machine: {Timestamp:2026-05-25 11:17:41.01447316 +0000 UTC m=+0.476528647 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098172 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d580ac9680ef54135d579b5f010ca SystemUUID:ec2d580a-c968-0ef5-4135-d579b5f010ca BootID:277b51f4-90ef-43b9-ad90-660470906f0a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:61:5b:7d:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:61:5b:7d:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:aa:64:11:6c:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 11:17:41.015091 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.015091    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 11:17:41.015218 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.015207    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 11:17:41.018380 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.018356    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 11:17:41.018517 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.018382    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 11:17:41.018578 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.018527    2562 topology_manager.go:138] "Creating topology manager with none policy"
May 25 11:17:41.018578 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.018535    2562 container_manager_linux.go:306] "Creating device plugin manager"
May 25 11:17:41.018578 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.018543    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:17:41.019519 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.019507    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:17:41.021484 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.021474    2562 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:17:41.021612 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.021602    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 11:17:41.024370 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.024361    2562 kubelet.go:491] "Attempting to sync node with API server"
May 25 11:17:41.024406 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.024375    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 11:17:41.024406 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.024389    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 11:17:41.024406 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.024399    2562 kubelet.go:397] "Adding apiserver pod source"
May 25 11:17:41.024522 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.024408    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 11:17:41.025772 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.025760    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:17:41.025823 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.025779    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:17:41.029646 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.029615    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 11:17:41.031972 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.031959    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 11:17:41.034662 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034648    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 11:17:41.034662 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034666    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 11:17:41.034662 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034672    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 11:17:41.034662 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034679    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034691    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034697    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034703    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034709    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034717    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034724    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034733    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034739    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034764    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 11:17:41.034880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.034773    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 11:17:41.038138 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.038122    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 11:17:41.038330 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.038160    2562 server.go:1295] "Started kubelet"
May 25 11:17:41.038330 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.038241    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 11:17:41.038330 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.038239    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 11:17:41.038434 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.038330    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 11:17:41.040651 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.040626    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 11:17:41.040741 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.040654    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 11:17:41.040741 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.040713    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 11:17:41.040651 ip-10-0-131-36 systemd[1]: Started Kubernetes Kubelet.
May 25 11:17:41.041322 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.041304    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 11:17:41.042103 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.042083    2562 server.go:317] "Adding debug handlers to kubelet server"
May 25 11:17:41.050217 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050203    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 11:17:41.050378 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.050358    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 11:17:41.050465 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050396    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 11:17:41.050552 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050542    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 11:17:41.050753 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050407    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 11:17:41.050840 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050421    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 11:17:41.050935 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050927    2562 reconstruct.go:97] "Volume reconstruction finished"
May 25 11:17:41.050935 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.050936    2562 reconciler.go:26] "Reconciler: start to sync state"
May 25 11:17:41.051166 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.049841    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18b2cadecd25f4b0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-05-25 11:17:41.038134448 +0000 UTC m=+0.500189938,LastTimestamp:2026-05-25 11:17:41.038134448 +0000 UTC m=+0.500189938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}"
May 25 11:17:41.051249 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.051218    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.051455 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051441    2562 factory.go:55] Registering systemd factory
May 25 11:17:41.051504 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051457    2562 factory.go:223] Registration of the systemd container factory successfully
May 25 11:17:41.051685 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051672    2562 factory.go:153] Registering CRI-O factory
May 25 11:17:41.051754 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051689    2562 factory.go:223] Registration of the crio container factory successfully
May 25 11:17:41.051754 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051748    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 11:17:41.051846 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051768    2562 factory.go:103] Registering Raw factory
May 25 11:17:41.051846 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.051785    2562 manager.go:1196] Started watching for new ooms in manager
May 25 11:17:41.052116 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.052103    2562 manager.go:319] Starting recovery of all containers
May 25 11:17:41.061298 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.061283    2562 manager.go:324] Recovery completed
May 25 11:17:41.063351 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.063329    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 25 11:17:41.063772 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.063747    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 25 11:17:41.065702 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.065686    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.067454 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.067427    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.067508 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.067472    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.067508 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.067488    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.067980 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.067963    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 11:17:41.068053 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.067984    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 11:17:41.068053 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.068000    2562 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:17:41.071990 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.071977    2562 policy_none.go:49] "None policy: Start"
May 25 11:17:41.072056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.071994    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 11:17:41.072056 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.072004    2562 state_mem.go:35] "Initializing new in-memory state store"
May 25 11:17:41.076057 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.075927    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5kw4s"
May 25 11:17:41.076113 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.075907    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18b2cadecee55bdb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-05-25 11:17:41.067455451 +0000 UTC m=+0.529510944,LastTimestamp:2026-05-25 11:17:41.067455451 +0000 UTC m=+0.529510944,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}"
May 25 11:17:41.082730 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.082713    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5kw4s"
May 25 11:17:41.086348 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.086275    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18b2cadecee5b826  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-05-25 11:17:41.067479078 +0000 UTC m=+0.529534564,LastTimestamp:2026-05-25 11:17:41.067479078 +0000 UTC m=+0.529534564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}"
May 25 11:17:41.118222 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118205    2562 manager.go:341] "Starting Device Plugin manager"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.118251    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118265    2562 server.go:85] "Starting device plugin registration server"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118528    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118539    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118645    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118735    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.118745    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.119218    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 11:17:41.135895 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.119253    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.152008 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.151982    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 11:17:41.153134 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.153109    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 11:17:41.153231 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.153140    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 11:17:41.153231 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.153164    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 11:17:41.153231 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.153178    2562 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 11:17:41.153366 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.153282    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 11:17:41.155709 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.155689    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:41.220258 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.220163    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.221178 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.221156    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.221276 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.221187    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.221276 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.221204    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.221276 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.221228    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-36.ec2.internal"
May 25 11:17:41.234937 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.234918    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-36.ec2.internal"
May 25 11:17:41.234992 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.234943    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-36.ec2.internal\": node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.254179 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.254154    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"]
May 25 11:17:41.254283 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.254220    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.254918 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.254901    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.255006 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.254992    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.255048 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.255020    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.255048 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.255033    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.257303 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.257291    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.257465 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.257452    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.257500 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.257480    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.257998 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.257979    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.257998 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.257990    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.258102 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.258009    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.258102 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.258019    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.258102 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.258009    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.258102 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.258099    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.260171 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.260158    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.260240 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.260182    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:17:41.260838 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.260825    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:17:41.260908 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.260849    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:17:41.260908 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.260862    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID"
May 25 11:17:41.285246 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.285222    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-36.ec2.internal\" not found" node="ip-10-0-131-36.ec2.internal"
May 25 11:17:41.289684 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.289669    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-36.ec2.internal\" not found" node="ip-10-0-131-36.ec2.internal"
May 25 11:17:41.352207 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.352175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.355630 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.355611    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.452579 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.452537    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.452686 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.452589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.452686 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.452641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.452756 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.452684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd18aa3e52833def90adf242a77f563b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"cd18aa3e52833def90adf242a77f563b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.456625 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.456610    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.553189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.553164    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.553286 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.553199    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd18aa3e52833def90adf242a77f563b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"cd18aa3e52833def90adf242a77f563b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.553286 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.553251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd18aa3e52833def90adf242a77f563b-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"cd18aa3e52833def90adf242a77f563b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.553286 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.553254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cebfbe5039a510c1232df7596848b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"93cebfbe5039a510c1232df7596848b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.557279 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.557258    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.588427 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.588405    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.593050 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.593036    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:41.657944 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.657910    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.758404 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.758376    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.858974 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.858891    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:41.865061 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.865043    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:41.950274 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.950247    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 11:17:41.950838 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.950394    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:17:41.950838 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:41.950429    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:17:41.959637 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:41.959614    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found"
May 25 11:17:42.051427 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.051395    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 11:17:42.054856 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.054836    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:42.072795 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.072763    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:17:42.084828 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.084780    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 11:12:41 +0000 UTC" deadline="2027-11-24 15:16:28.472926016 +0000 UTC"
May 25 11:17:42.084923 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.084829    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13155h58m46.388101261s"
May 25 11:17:42.126623 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.126551    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz25t"
May 25 11:17:42.136986 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.136966    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz25t"
May 25 11:17:42.150037 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:42.150011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd18aa3e52833def90adf242a77f563b.slice/crio-9ef0df93f7a9914e6d48a143d6a1ece1e8f7ca671de2cb9fa154acc23fd3b535 WatchSource:0}: Error finding container 9ef0df93f7a9914e6d48a143d6a1ece1e8f7ca671de2cb9fa154acc23fd3b535: Status 404 returned error can't find the container with id 9ef0df93f7a9914e6d48a143d6a1ece1e8f7ca671de2cb9fa154acc23fd3b535
May 25 11:17:42.150287 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:42.150269    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cebfbe5039a510c1232df7596848b3.slice/crio-1f11db76889caf5cb528ba19ba139dbb9dd5006b127453cadc2b7dbc70f9faf2 WatchSource:0}: Error finding container 1f11db76889caf5cb528ba19ba139dbb9dd5006b127453cadc2b7dbc70f9faf2: Status 404 returned error can't find the container with id 1f11db76889caf5cb528ba19ba139dbb9dd5006b127453cadc2b7dbc70f9faf2
May 25 11:17:42.151358 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.151341    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"
May 25 11:17:42.153587 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.153561    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:17:42.155915 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.155879    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" event={"ID":"cd18aa3e52833def90adf242a77f563b","Type":"ContainerStarted","Data":"9ef0df93f7a9914e6d48a143d6a1ece1e8f7ca671de2cb9fa154acc23fd3b535"}
May 25 11:17:42.156752 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.156725    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"93cebfbe5039a510c1232df7596848b3","Type":"ContainerStarted","Data":"1f11db76889caf5cb528ba19ba139dbb9dd5006b127453cadc2b7dbc70f9faf2"}
May 25 11:17:42.164098 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.164077    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:17:42.165013 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.165001    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"
May 25 11:17:42.182353 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.182338    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:17:42.479349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.479262    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:42.897927 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:42.897723    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:43.025427 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.025392    2562 apiserver.go:52] "Watching apiserver"
May 25 11:17:43.032457 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.032431    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 11:17:43.032869 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.032831    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-56c82","kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal","openshift-multus/multus-n5xwt","openshift-network-diagnostics/network-check-target-qgcjm","openshift-network-operator/iptables-alerter-twfll","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx","openshift-cluster-node-tuning-operator/tuned-gwpht","openshift-image-registry/node-ca-j6f2b","openshift-multus/multus-additional-cni-plugins-dft5z","openshift-multus/network-metrics-daemon-82b7t","openshift-ovn-kubernetes/ovnkube-node-25sdt"]
May 25 11:17:43.035674 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.035653    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.038154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.038125    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 11:17:43.038242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.038155    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 11:17:43.038386 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.038366    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hhwzg\""
May 25 11:17:43.040052 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.040028    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.042211 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.042101    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 11:17:43.042211 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.042181    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.042841 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.042708    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 11:17:43.042841 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.042780    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gszzw\""
May 25 11:17:43.044189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.044171    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 11:17:43.044289 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.044213    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 11:17:43.044753 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.044648    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:43.044753 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.044734    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:43.044866 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.044833    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 11:17:43.045122 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.045093    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n5r4b\""
May 25 11:17:43.045122 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.045114    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 11:17:43.045240 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.045142    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 11:17:43.047146 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.046955    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.047146 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.047076    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.049387 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.049304    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.049739 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.049660    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 11:17:43.049948 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.049896    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 11:17:43.050029 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.049995    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 11:17:43.050130 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.050111    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 11:17:43.050510 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.050495    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bvsdf\""
May 25 11:17:43.050705 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.050689    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kmbkd\""
May 25 11:17:43.050862 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.050836    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 11:17:43.051528 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.051408    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 11:17:43.051528 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.051512    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 11:17:43.052217 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.052198    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hw9xl\""
May 25 11:17:43.053339 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.053270    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 11:17:43.054806 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.054780    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.054896 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.054882    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.055193 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.055154    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:43.058617 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.058597    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.059050 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.059025    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 11:17:43.059926 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.059902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-cnibin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.060005 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.059943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-bin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.060005 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.059985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-host\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060108 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7200fdf4-060c-4a20-9a58-11e8a69cdcea-iptables-alerter-script\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.060108 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79vrn\" (UniqueName: \"kubernetes.io/projected/7200fdf4-060c-4a20-9a58-11e8a69cdcea-kube-api-access-79vrn\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.060108 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgcs\" (UniqueName: \"kubernetes.io/projected/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kube-api-access-7lgcs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.060108 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-run\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060108 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87zg\" (UniqueName: \"kubernetes.io/projected/4f528594-3c6a-46e9-9273-7b35c4b8660f-kube-api-access-g87zg\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-lib-modules\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-device-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-system-cni-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552f8bf2-28bd-4763-8a1b-d869d39f4126-agent-certs\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.060349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-cni-binary-copy\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-modprobe-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-sys\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74897e03-4185-4a7e-ac3e-2be15c3ee545-host\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7200fdf4-060c-4a20-9a58-11e8a69cdcea-host-slash\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-socket-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-tmp\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-hostroot\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.060701 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-multus-certs\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-kubernetes\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-etc-tuned\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrv2\" (UniqueName: \"kubernetes.io/projected/74897e03-4185-4a7e-ac3e-2be15c3ee545-kube-api-access-hnrv2\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-k8s-cni-cncf-io\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-netns\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzx9\" (UniqueName: \"kubernetes.io/projected/cba8d391-17d8-4437-9932-e9489ed8f788-kube-api-access-8nzx9\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-registration-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-system-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-etc-kubernetes\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.060993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-conf-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysconfig\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-var-lib-kubelet\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061189 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74897e03-4185-4a7e-ac3e-2be15c3ee545-serviceca\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-multus\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-os-release\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552f8bf2-28bd-4763-8a1b-d869d39f4126-konnectivity-ca\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-socket-dir-parent\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-multus-daemon-config\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-conf\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-cnibin\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061541    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jcj7\""
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-os-release\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-systemd\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-sys-fs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-kubelet\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8658t\" (UniqueName: \"kubernetes.io/projected/158382fe-3769-4a95-aef6-8e5696df30e9-kube-api-access-8658t\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.061934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.061769    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 11:17:43.065095 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.065078    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 11:17:43.066521 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.066499    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5rv8b\""
May 25 11:17:43.066632 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.066554    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 11:17:43.066632 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.066598    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 11:17:43.066738 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.066679    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 11:17:43.066790 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.066755    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 11:17:43.067320 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.067302    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 11:17:43.138045 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.138008    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:12:42 +0000 UTC" deadline="2027-12-06 03:15:59.412855154 +0000 UTC"
May 25 11:17:43.138045 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.138035    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13431h58m16.274822406s"
May 25 11:17:43.151764 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.151693    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 11:17:43.162172 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162146    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-system-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162182    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-etc-kubernetes\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-netns\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162241    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162265    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-conf-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-etc-kubernetes\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162288    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysconfig\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.162304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162298    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-system-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162312    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-var-lib-kubelet\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-conf-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162352    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74897e03-4185-4a7e-ac3e-2be15c3ee545-serviceca\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-cni-dir\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-var-lib-kubelet\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162387    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162430    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-multus\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-netd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162527    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-os-release\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.162592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-multus\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74897e03-4185-4a7e-ac3e-2be15c3ee545-serviceca\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162407    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysconfig\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.162995    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552f8bf2-28bd-4763-8a1b-d869d39f4126-konnectivity-ca\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163024    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-socket-dir-parent\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-os-release\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163084    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-multus-daemon-config\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163105    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-conf\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-conf\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-node-log\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5755389d-04a5-45c5-b606-0e0f6b265c40-ovn-node-metrics-cert\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-cnibin\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163372    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-os-release\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163393    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-systemd\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163409    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-sys-fs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163432    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-kubelet\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163474 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163462    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8658t\" (UniqueName: \"kubernetes.io/projected/158382fe-3769-4a95-aef6-8e5696df30e9-kube-api-access-8658t\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-slash\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsllm\" (UniqueName: \"kubernetes.io/projected/5755389d-04a5-45c5-b606-0e0f6b265c40-kube-api-access-xsllm\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552f8bf2-28bd-4763-8a1b-d869d39f4126-konnectivity-ca\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163559    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-cnibin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163592    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-bin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-cni-bin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-var-lib-kubelet\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163609    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-cnibin\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163699    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-os-release\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-host\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163778    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-sys-fs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-systemd\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163798    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-multus-socket-dir-parent\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-multus-daemon-config\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7200fdf4-060c-4a20-9a58-11e8a69cdcea-iptables-alerter-script\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163880    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79vrn\" (UniqueName: \"kubernetes.io/projected/7200fdf4-060c-4a20-9a58-11e8a69cdcea-kube-api-access-79vrn\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-cnibin\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.163951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-ovn\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.163957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164006    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgcs\" (UniqueName: \"kubernetes.io/projected/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kube-api-access-7lgcs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164041    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-run\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxsq\" (UniqueName: \"kubernetes.io/projected/dfe8c912-6fa2-4816-98c3-96899256f4d3-kube-api-access-bqxsq\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164123    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g87zg\" (UniqueName: \"kubernetes.io/projected/4f528594-3c6a-46e9-9273-7b35c4b8660f-kube-api-access-g87zg\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-script-lib\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-run\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164265    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-lib-modules\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-env-overrides\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164328    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-device-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164355    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-host\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164382    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-system-cni-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164436    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-device-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.164762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-lib-modules\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7200fdf4-060c-4a20-9a58-11e8a69cdcea-iptables-alerter-script\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-system-cni-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164557    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552f8bf2-28bd-4763-8a1b-d869d39f4126-agent-certs\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164617    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-cni-binary-copy\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164662    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-config\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164713    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-modprobe-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164736    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-sys\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164784    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74897e03-4185-4a7e-ac3e-2be15c3ee545-host\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164793    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-sysctl-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-modprobe-d\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-systemd-units\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-sys\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-log-socket\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164854    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74897e03-4185-4a7e-ac3e-2be15c3ee545-host\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.165459 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164885    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164908    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7200fdf4-060c-4a20-9a58-11e8a69cdcea-host-slash\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-etc-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164972    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-socket-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.164981    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7200fdf4-060c-4a20-9a58-11e8a69cdcea-host-slash\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165024    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165029    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165075    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-tmp\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-socket-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-systemd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158382fe-3769-4a95-aef6-8e5696df30e9-cni-binary-copy\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-var-lib-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165349    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-hostroot\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165376    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-multus-certs\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165401    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-kubernetes\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165424    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-etc-tuned\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-hostroot\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-multus-certs\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.166151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165451    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrv2\" (UniqueName: \"kubernetes.io/projected/74897e03-4185-4a7e-ac3e-2be15c3ee545-kube-api-access-hnrv2\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165494    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165519    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-k8s-cni-cncf-io\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165542    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cba8d391-17d8-4437-9932-e9489ed8f788-etc-kubernetes\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165543    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-netns\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-netns\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165595    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzx9\" (UniqueName: \"kubernetes.io/projected/cba8d391-17d8-4437-9932-e9489ed8f788-kube-api-access-8nzx9\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-kubelet\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-bin\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165711    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-registration-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165735    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f528594-3c6a-46e9-9273-7b35c4b8660f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158382fe-3769-4a95-aef6-8e5696df30e9-host-run-k8s-cni-cncf-io\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.165980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60d41bcc-850b-4e26-98f9-5d59cc9afff2-registration-dir\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.166212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.167060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.166895    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f528594-3c6a-46e9-9273-7b35c4b8660f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.168256 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.168216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-tmp\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.168342 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.168260    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cba8d391-17d8-4437-9932-e9489ed8f788-etc-tuned\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.168668 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.168648    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552f8bf2-28bd-4763-8a1b-d869d39f4126-agent-certs\") pod \"konnectivity-agent-56c82\" (UID: \"552f8bf2-28bd-4763-8a1b-d869d39f4126\") " pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.173669 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.173645    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:43.173768 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.173674    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:43.173768 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.173699    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.173868 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.173851    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:17:43.673801406 +0000 UTC m=+3.135856906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.176343 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.176322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8658t\" (UniqueName: \"kubernetes.io/projected/158382fe-3769-4a95-aef6-8e5696df30e9-kube-api-access-8658t\") pod \"multus-n5xwt\" (UID: \"158382fe-3769-4a95-aef6-8e5696df30e9\") " pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.176540 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.176420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrv2\" (UniqueName: \"kubernetes.io/projected/74897e03-4185-4a7e-ac3e-2be15c3ee545-kube-api-access-hnrv2\") pod \"node-ca-j6f2b\" (UID: \"74897e03-4185-4a7e-ac3e-2be15c3ee545\") " pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.178112 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.177957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzx9\" (UniqueName: \"kubernetes.io/projected/cba8d391-17d8-4437-9932-e9489ed8f788-kube-api-access-8nzx9\") pod \"tuned-gwpht\" (UID: \"cba8d391-17d8-4437-9932-e9489ed8f788\") " pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.179244 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.179220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgcs\" (UniqueName: \"kubernetes.io/projected/60d41bcc-850b-4e26-98f9-5d59cc9afff2-kube-api-access-7lgcs\") pod \"aws-ebs-csi-driver-node-r8qgx\" (UID: \"60d41bcc-850b-4e26-98f9-5d59cc9afff2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.179856 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.179834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87zg\" (UniqueName: \"kubernetes.io/projected/4f528594-3c6a-46e9-9273-7b35c4b8660f-kube-api-access-g87zg\") pod \"multus-additional-cni-plugins-dft5z\" (UID: \"4f528594-3c6a-46e9-9273-7b35c4b8660f\") " pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.180252 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.180236    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79vrn\" (UniqueName: \"kubernetes.io/projected/7200fdf4-060c-4a20-9a58-11e8a69cdcea-kube-api-access-79vrn\") pod \"iptables-alerter-twfll\" (UID: \"7200fdf4-060c-4a20-9a58-11e8a69cdcea\") " pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.266430 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266394    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-etc-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266430 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266434    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-systemd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266452    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-var-lib-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-etc-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266529    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-systemd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-var-lib-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266609    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-kubelet\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266663 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-bin\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266673    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-netns\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-kubelet\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-bin\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266742    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266774    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-netd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-netns\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266802    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-node-log\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266830    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5755389d-04a5-45c5-b606-0e0f6b265c40-ovn-node-metrics-cert\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266845    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-cni-netd\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-slash\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266882    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsllm\" (UniqueName: \"kubernetes.io/projected/5755389d-04a5-45c5-b606-0e0f6b265c40-kube-api-access-xsllm\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-node-log\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266912    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-ovn\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266936    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-slash\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.266943 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.266884    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266962    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxsq\" (UniqueName: \"kubernetes.io/projected/dfe8c912-6fa2-4816-98c3-96899256f4d3-kube-api-access-bqxsq\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.266990    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-script-lib\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.267051    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:43.767031303 +0000 UTC m=+3.229086798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267087    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-env-overrides\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267121    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-config\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267162    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-systemd-units\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267187    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-log-socket\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-log-socket\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-host-run-ovn-kubernetes\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-ovn\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-script-lib\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.267720 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-run-openvswitch\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.268261 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.267878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5755389d-04a5-45c5-b606-0e0f6b265c40-systemd-units\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.268261 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.268063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-env-overrides\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.268261 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.268085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5755389d-04a5-45c5-b606-0e0f6b265c40-ovnkube-config\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.269979 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.269956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5755389d-04a5-45c5-b606-0e0f6b265c40-ovn-node-metrics-cert\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.278836 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.278818    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsllm\" (UniqueName: \"kubernetes.io/projected/5755389d-04a5-45c5-b606-0e0f6b265c40-kube-api-access-xsllm\") pod \"ovnkube-node-25sdt\" (UID: \"5755389d-04a5-45c5-b606-0e0f6b265c40\") " pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.279227 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.279210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxsq\" (UniqueName: \"kubernetes.io/projected/dfe8c912-6fa2-4816-98c3-96899256f4d3-kube-api-access-bqxsq\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.349196 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.349151    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-56c82"
May 25 11:17:43.357061 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.357034    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5xwt"
May 25 11:17:43.367836 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.367810    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twfll"
May 25 11:17:43.373536 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.373511    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx"
May 25 11:17:43.380173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.380153    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gwpht"
May 25 11:17:43.385723 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.385693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j6f2b"
May 25 11:17:43.392269 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.392240    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dft5z"
May 25 11:17:43.396897 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.396862    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:17:43.771151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.771044    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:43.771151 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:43.771110    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:43.771329 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771213    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:43.771329 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771240    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:43.771329 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771253    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.771329 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:17:44.771296501 +0000 UTC m=+4.233351995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:43.771695 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771219    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.771822 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:43.771755    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:44.771734939 +0000 UTC m=+4.233790434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:43.774912 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.774831    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158382fe_3769_4a95_aef6_8e5696df30e9.slice/crio-4c8822ac88a7eef787c0f62fbe23206ef7667a0a1cae351cbcffd396ffbf1702 WatchSource:0}: Error finding container 4c8822ac88a7eef787c0f62fbe23206ef7667a0a1cae351cbcffd396ffbf1702: Status 404 returned error can't find the container with id 4c8822ac88a7eef787c0f62fbe23206ef7667a0a1cae351cbcffd396ffbf1702
May 25 11:17:43.777098 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.777077    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552f8bf2_28bd_4763_8a1b_d869d39f4126.slice/crio-b0ee44839dc95f98570586c780df1dca255231bf14f84c493c61ee8171d44eb9 WatchSource:0}: Error finding container b0ee44839dc95f98570586c780df1dca255231bf14f84c493c61ee8171d44eb9: Status 404 returned error can't find the container with id b0ee44839dc95f98570586c780df1dca255231bf14f84c493c61ee8171d44eb9
May 25 11:17:43.777642 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.777613    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba8d391_17d8_4437_9932_e9489ed8f788.slice/crio-e9bbab6356063669c6b22a46a0621e9b1ac4a779618c1c882042ad02b485b6a5 WatchSource:0}: Error finding container e9bbab6356063669c6b22a46a0621e9b1ac4a779618c1c882042ad02b485b6a5: Status 404 returned error can't find the container with id e9bbab6356063669c6b22a46a0621e9b1ac4a779618c1c882042ad02b485b6a5
May 25 11:17:43.778711 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.778589    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d41bcc_850b_4e26_98f9_5d59cc9afff2.slice/crio-b6b547078365f5240ae80cc354e638e660a5c7ab266330211c86d78ad07edf42 WatchSource:0}: Error finding container b6b547078365f5240ae80cc354e638e660a5c7ab266330211c86d78ad07edf42: Status 404 returned error can't find the container with id b6b547078365f5240ae80cc354e638e660a5c7ab266330211c86d78ad07edf42
May 25 11:17:43.779425 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.779259    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5755389d_04a5_45c5_b606_0e0f6b265c40.slice/crio-a24f26b2bbfe124aec45db8e0317f3ba129ffd9422406d91e7684f3d67e36363 WatchSource:0}: Error finding container a24f26b2bbfe124aec45db8e0317f3ba129ffd9422406d91e7684f3d67e36363: Status 404 returned error can't find the container with id a24f26b2bbfe124aec45db8e0317f3ba129ffd9422406d91e7684f3d67e36363
May 25 11:17:43.780258 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.780175    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74897e03_4185_4a7e_ac3e_2be15c3ee545.slice/crio-8662f25890d7c2abd98ad620ace1548a21df74996f7e62763d44cb62650dccbc WatchSource:0}: Error finding container 8662f25890d7c2abd98ad620ace1548a21df74996f7e62763d44cb62650dccbc: Status 404 returned error can't find the container with id 8662f25890d7c2abd98ad620ace1548a21df74996f7e62763d44cb62650dccbc
May 25 11:17:43.781140 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.781123    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7200fdf4_060c_4a20_9a58_11e8a69cdcea.slice/crio-02de93fc0936b0a39c50058b7bb6bc932ab0b8b285dfc2ae0c0a4f0f39d91e2a WatchSource:0}: Error finding container 02de93fc0936b0a39c50058b7bb6bc932ab0b8b285dfc2ae0c0a4f0f39d91e2a: Status 404 returned error can't find the container with id 02de93fc0936b0a39c50058b7bb6bc932ab0b8b285dfc2ae0c0a4f0f39d91e2a
May 25 11:17:43.783221 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:17:43.783198    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f528594_3c6a_46e9_9273_7b35c4b8660f.slice/crio-37479005a169e9fd192b4445b67857cea03e9f01fd74939c8d436b0153bcab22 WatchSource:0}: Error finding container 37479005a169e9fd192b4445b67857cea03e9f01fd74939c8d436b0153bcab22: Status 404 returned error can't find the container with id 37479005a169e9fd192b4445b67857cea03e9f01fd74939c8d436b0153bcab22
May 25 11:17:44.138839 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.138578    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:12:42 +0000 UTC" deadline="2028-02-28 05:54:17.056091872 +0000 UTC"
May 25 11:17:44.138839 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.138838    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15450h36m32.917259918s"
May 25 11:17:44.161693 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.161651    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" event={"ID":"cd18aa3e52833def90adf242a77f563b","Type":"ContainerStarted","Data":"949eb3aec21dd2096963f5503d3caca9115c2d1b7619d4c1d201a997cb75e192"}
May 25 11:17:44.164781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.164753    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerStarted","Data":"37479005a169e9fd192b4445b67857cea03e9f01fd74939c8d436b0153bcab22"}
May 25 11:17:44.167023 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.166968    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twfll" event={"ID":"7200fdf4-060c-4a20-9a58-11e8a69cdcea","Type":"ContainerStarted","Data":"02de93fc0936b0a39c50058b7bb6bc932ab0b8b285dfc2ae0c0a4f0f39d91e2a"}
May 25 11:17:44.170359 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.170304    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx" event={"ID":"60d41bcc-850b-4e26-98f9-5d59cc9afff2","Type":"ContainerStarted","Data":"b6b547078365f5240ae80cc354e638e660a5c7ab266330211c86d78ad07edf42"}
May 25 11:17:44.171576 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.171512    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-56c82" event={"ID":"552f8bf2-28bd-4763-8a1b-d869d39f4126","Type":"ContainerStarted","Data":"b0ee44839dc95f98570586c780df1dca255231bf14f84c493c61ee8171d44eb9"}
May 25 11:17:44.173642 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.173611    2562 generic.go:358] "Generic (PLEG): container finished" podID="93cebfbe5039a510c1232df7596848b3" containerID="b30b2cb196236cd79386531a23c9d2502f6c81a1df020e2bb34a5e41fcad0b1c" exitCode=0
May 25 11:17:44.173758 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.173681    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"93cebfbe5039a510c1232df7596848b3","Type":"ContainerDied","Data":"b30b2cb196236cd79386531a23c9d2502f6c81a1df020e2bb34a5e41fcad0b1c"}
May 25 11:17:44.174455 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.174316    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" podStartSLOduration=2.174301937 podStartE2EDuration="2.174301937s" podCreationTimestamp="2026-05-25 11:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:17:44.174012931 +0000 UTC m=+3.636068428" watchObservedRunningTime="2026-05-25 11:17:44.174301937 +0000 UTC m=+3.636357435"
May 25 11:17:44.185170 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.183325    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j6f2b" event={"ID":"74897e03-4185-4a7e-ac3e-2be15c3ee545","Type":"ContainerStarted","Data":"8662f25890d7c2abd98ad620ace1548a21df74996f7e62763d44cb62650dccbc"}
May 25 11:17:44.196029 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.195988    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"a24f26b2bbfe124aec45db8e0317f3ba129ffd9422406d91e7684f3d67e36363"}
May 25 11:17:44.216556 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.216527    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gwpht" event={"ID":"cba8d391-17d8-4437-9932-e9489ed8f788","Type":"ContainerStarted","Data":"e9bbab6356063669c6b22a46a0621e9b1ac4a779618c1c882042ad02b485b6a5"}
May 25 11:17:44.225750 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.225717    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5xwt" event={"ID":"158382fe-3769-4a95-aef6-8e5696df30e9","Type":"ContainerStarted","Data":"4c8822ac88a7eef787c0f62fbe23206ef7667a0a1cae351cbcffd396ffbf1702"}
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.780886    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.780956    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781103    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:46.781149236 +0000 UTC m=+6.243204731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781603    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781622    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781635    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:44.781764 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:44.781681    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:17:46.781664984 +0000 UTC m=+6.243720472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:44.915541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:44.915506    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:17:45.155238 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:45.154716    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:45.155238 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:45.154854    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:45.156197 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:45.156015    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:45.156197 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:45.156123    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:45.238559 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:45.238495    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"93cebfbe5039a510c1232df7596848b3","Type":"ContainerStarted","Data":"e22d799a11cb18a5fe69c7f7de400bba919f346d097221c1b0da57874fc7d7d8"}
May 25 11:17:46.798415 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:46.797819    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:46.798415 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:46.797882    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:46.798415 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798035    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:46.798415 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798093    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:50.798074555 +0000 UTC m=+10.260130044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:46.798415 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798417    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:46.799110 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798479    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:46.799110 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798492    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:46.799110 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:46.798541    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:17:50.798524753 +0000 UTC m=+10.260580242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:47.154276 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:47.154199    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:47.154432 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:47.154355    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:47.154668 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:47.154638    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:47.154777 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:47.154734    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:49.154200 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:49.154170    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:49.154671 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:49.154266    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:49.154671 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:49.154612    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:49.154785 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:49.154683    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:50.833734    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:50.833807    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.833928    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.833987    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:17:58.833966865 +0000 UTC m=+18.296022358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.834375    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.834393    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.834406    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:50.834478 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:50.834452    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:17:58.834434893 +0000 UTC m=+18.296490380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:51.155386 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:51.154976    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:51.155386 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:51.155080    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:51.155386 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:51.155222    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:51.155386 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:51.155309    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:53.154288 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:53.154254    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:53.154865 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:53.154294    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:53.154865 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:53.154394    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:53.154865 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:53.154488    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:55.153355 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:55.153323    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:55.153778 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:55.153323    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:55.153778 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:55.153442    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:55.153778 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:55.153521    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:57.153697 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:57.153662    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:57.154160 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:57.153698    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:57.154160 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:57.153785    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:57.154160 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:57.153892    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:17:58.897017 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:58.896981    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:58.897033    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897128    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897159    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897182    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:14.897163982 +0000 UTC m=+34.359219457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897183    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897198    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:58.897578 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:58.897250    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:18:14.897231871 +0000 UTC m=+34.359287357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:17:59.154154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:59.154072    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:17:59.154154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:17:59.154097    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:17:59.154367 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:59.154193    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:17:59.154421 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:17:59.154355    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:01.154113 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:01.154089    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:01.154421 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:01.154187    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:01.154421 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:01.154266    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:01.154421 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:01.154348    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:02.268271 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.267872    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="4b16e7b6d4ff44c0d0b6c06b932acf822aebe00ba10e9667c20b750f2f69dc03" exitCode=0
May 25 11:18:02.268271 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.267971    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"4b16e7b6d4ff44c0d0b6c06b932acf822aebe00ba10e9667c20b750f2f69dc03"}
May 25 11:18:02.269781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.269755    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx" event={"ID":"60d41bcc-850b-4e26-98f9-5d59cc9afff2","Type":"ContainerStarted","Data":"04261a8fe935fe1658027563a3d067c35687b1db7781f3e7415c664ed00cbec0"}
May 25 11:18:02.271167 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.271118    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-56c82" event={"ID":"552f8bf2-28bd-4763-8a1b-d869d39f4126","Type":"ContainerStarted","Data":"666240d5f38b556d7cf4a58f447ea3266f9158a3ee926b36cdef4cd11a0e9cca"}
May 25 11:18:02.276423 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.276394    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j6f2b" event={"ID":"74897e03-4185-4a7e-ac3e-2be15c3ee545","Type":"ContainerStarted","Data":"e255583d2f7af7f144e311917f163fd7519b1c46c72eaa9269f82d2c389f468b"}
May 25 11:18:02.279810 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.279793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:18:02.280182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280109    2562 generic.go:358] "Generic (PLEG): container finished" podID="5755389d-04a5-45c5-b606-0e0f6b265c40" containerID="458402984ac2ea06184748ac18b353c4a865457a919654f7177f206907eba841" exitCode=1
May 25 11:18:02.280182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280130    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"7fd3fa8d730ef8578c02e529ba1c4e42ad0963db3761234a39d7672158d859ed"}
May 25 11:18:02.280182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280169    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"f4120db5457ae87ea1122a1fd4997ffc281a3e47c7fb839243b8e1fdcb9c22eb"}
May 25 11:18:02.280182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280183    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"b8ef2262b4dce83499ba2372e1f3a0097aa4740ca7627d606c669bea116bb843"}
May 25 11:18:02.280358 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280195    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"28b1f801f8dabfde58e58f24b5d803ee3479db5245fcd1577894c0938305b1a1"}
May 25 11:18:02.280358 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280205    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerDied","Data":"458402984ac2ea06184748ac18b353c4a865457a919654f7177f206907eba841"}
May 25 11:18:02.280358 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.280219    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"fe35a0e1349be55c95e4ef9ad5bb72d5846200c1dd83a5ef8533f1bad1158917"}
May 25 11:18:02.281527 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.281504    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gwpht" event={"ID":"cba8d391-17d8-4437-9932-e9489ed8f788","Type":"ContainerStarted","Data":"7b06b039793018909b2deea021420d499c603daff9e2806ad38e144eb99639a1"}
May 25 11:18:02.282881 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.282862    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5xwt" event={"ID":"158382fe-3769-4a95-aef6-8e5696df30e9","Type":"ContainerStarted","Data":"7660f95f9e2372b78359f10a00afa632806ece16761480183418493079e2f123"}
May 25 11:18:02.290912 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.290865    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" podStartSLOduration=20.290850466 podStartE2EDuration="20.290850466s" podCreationTimestamp="2026-05-25 11:17:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:17:45.251687438 +0000 UTC m=+4.713742936" watchObservedRunningTime="2026-05-25 11:18:02.290850466 +0000 UTC m=+21.752905967"
May 25 11:18:02.316523 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.316489    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j6f2b" podStartSLOduration=3.830179828 podStartE2EDuration="21.316479408s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.782160567 +0000 UTC m=+3.244216045" lastFinishedPulling="2026-05-25 11:18:01.268460151 +0000 UTC m=+20.730515625" observedRunningTime="2026-05-25 11:18:02.316393547 +0000 UTC m=+21.778449039" watchObservedRunningTime="2026-05-25 11:18:02.316479408 +0000 UTC m=+21.778534904"
May 25 11:18:02.316851 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.316825    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-56c82" podStartSLOduration=8.484626521 podStartE2EDuration="21.31680341s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.778998268 +0000 UTC m=+3.241053742" lastFinishedPulling="2026-05-25 11:17:56.611175154 +0000 UTC m=+16.073230631" observedRunningTime="2026-05-25 11:18:02.303439051 +0000 UTC m=+21.765494547" watchObservedRunningTime="2026-05-25 11:18:02.31680341 +0000 UTC m=+21.778858905"
May 25 11:18:02.331695 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.331658    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n5xwt" podStartSLOduration=3.701624026 podStartE2EDuration="21.331650457s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.776500094 +0000 UTC m=+3.238555568" lastFinishedPulling="2026-05-25 11:18:01.406526514 +0000 UTC m=+20.868581999" observedRunningTime="2026-05-25 11:18:02.331208856 +0000 UTC m=+21.793264352" watchObservedRunningTime="2026-05-25 11:18:02.331650457 +0000 UTC m=+21.793705953"
May 25 11:18:02.777207 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:02.777169    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 11:18:03.131545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.131333    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T11:18:02.777193189Z","UUID":"f22de5da-f980-4e9b-9bf1-832c743e5f13","Handler":null,"Name":"","Endpoint":""}
May 25 11:18:03.134038 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.134012    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 11:18:03.134038 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.134041    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 11:18:03.154048 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.154018    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:03.154171 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:03.154131    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:03.154229 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.154192    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:03.154335 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:03.154313    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:03.287330 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.287297    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twfll" event={"ID":"7200fdf4-060c-4a20-9a58-11e8a69cdcea","Type":"ContainerStarted","Data":"7cfdb67644133834de2492f10280f7b03aa0ed19fb2e30e4ebeb17af3e17b8e8"}
May 25 11:18:03.289624 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.289528    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx" event={"ID":"60d41bcc-850b-4e26-98f9-5d59cc9afff2","Type":"ContainerStarted","Data":"dbd43daa256738efbb672d33b5a0856b5e7890defdae81b61216b4c845cfeebc"}
May 25 11:18:03.320032 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.319983    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twfll" podStartSLOduration=4.834431256 podStartE2EDuration="22.319968028s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.782783247 +0000 UTC m=+3.244838733" lastFinishedPulling="2026-05-25 11:18:01.268320028 +0000 UTC m=+20.730375505" observedRunningTime="2026-05-25 11:18:03.319792493 +0000 UTC m=+22.781847988" watchObservedRunningTime="2026-05-25 11:18:03.319968028 +0000 UTC m=+22.782023525"
May 25 11:18:03.320199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:03.320168    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gwpht" podStartSLOduration=4.796960085 podStartE2EDuration="22.320160443s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.779508892 +0000 UTC m=+3.241564366" lastFinishedPulling="2026-05-25 11:18:01.302709239 +0000 UTC m=+20.764764724" observedRunningTime="2026-05-25 11:18:02.350650299 +0000 UTC m=+21.812705795" watchObservedRunningTime="2026-05-25 11:18:03.320160443 +0000 UTC m=+22.782215939"
May 25 11:18:04.293494 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:04.293464    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx" event={"ID":"60d41bcc-850b-4e26-98f9-5d59cc9afff2","Type":"ContainerStarted","Data":"4ec3f2e8fd3aa527b4b48152941ca47f2e9619e78b388677625316a201519c67"}
May 25 11:18:04.314087 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:04.314039    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8qgx" podStartSLOduration=3.445952023 podStartE2EDuration="23.314023601s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.78080111 +0000 UTC m=+3.242856583" lastFinishedPulling="2026-05-25 11:18:03.648872683 +0000 UTC m=+23.110928161" observedRunningTime="2026-05-25 11:18:04.313702096 +0000 UTC m=+23.775757595" watchObservedRunningTime="2026-05-25 11:18:04.314023601 +0000 UTC m=+23.776079096"
May 25 11:18:05.154364 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:05.154329    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:05.154547 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:05.154326    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:05.154547 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:05.154451    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:05.154547 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:05.154525    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:05.298058 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:05.298028    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:18:05.298656 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:05.298450    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"113be1bcc0e603cd4e0d2f2d31fdc282949dbdbb1f028baabfceae62344e3560"}
May 25 11:18:06.301408 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:06.301150    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerStarted","Data":"4011656e364713a890aa7bf06fbe2192dff2b2324698b3ad52505ff333e3fbf2"}
May 25 11:18:07.020722 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.020696    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-56c82"
May 25 11:18:07.021200 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.021180    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-56c82"
May 25 11:18:07.155882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.155857    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:07.156007 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.155857    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:07.156007 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:07.155940    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:07.156086 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:07.156015    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:07.304104 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.304082    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="4011656e364713a890aa7bf06fbe2192dff2b2324698b3ad52505ff333e3fbf2" exitCode=0
May 25 11:18:07.304608 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.304161    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"4011656e364713a890aa7bf06fbe2192dff2b2324698b3ad52505ff333e3fbf2"}
May 25 11:18:07.307377 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.307361    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:18:07.307749 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.307718    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"e3b3753d0e3facf99851fabd062cb9d766bb519cfc6d454b1a60ee739eb59110"}
May 25 11:18:07.308138 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.308122    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:07.308194 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.308148    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:07.308287 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.308273    2562 scope.go:117] "RemoveContainer" containerID="458402984ac2ea06184748ac18b353c4a865457a919654f7177f206907eba841"
May 25 11:18:07.327195 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:07.327172    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:08.314699 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.314397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:18:08.315414 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.315149    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" event={"ID":"5755389d-04a5-45c5-b606-0e0f6b265c40","Type":"ContainerStarted","Data":"662efd76fa128c4bdfbb807c29f59ccb6e3d48d63e79349f852602e001c8edd6"}
May 25 11:18:08.315675 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.315647    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:08.318160 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.318127    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="abe0865db5988e6248ea6f811c308f097a3227dc549148c661ea71373f115f5a" exitCode=0
May 25 11:18:08.318262 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.318187    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"abe0865db5988e6248ea6f811c308f097a3227dc549148c661ea71373f115f5a"}
May 25 11:18:08.323124 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.323002    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82b7t"]
May 25 11:18:08.323218 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.323167    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:08.323266 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:08.323251    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:08.327611 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.327037    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgcjm"]
May 25 11:18:08.327611 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.327130    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:08.327611 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:08.327208    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:08.333164 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.333146    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:08.355170 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:08.355131    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt" podStartSLOduration=9.783520366 podStartE2EDuration="27.355120823s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.78204512 +0000 UTC m=+3.244100594" lastFinishedPulling="2026-05-25 11:18:01.353645565 +0000 UTC m=+20.815701051" observedRunningTime="2026-05-25 11:18:08.354762628 +0000 UTC m=+27.816818137" watchObservedRunningTime="2026-05-25 11:18:08.355120823 +0000 UTC m=+27.817176318"
May 25 11:18:09.322343 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:09.322315    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="d1138254e71b921944ab7688779f0370d19bc88cb12cca4539000947b8c08f4d" exitCode=0
May 25 11:18:09.322844 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:09.322397    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"d1138254e71b921944ab7688779f0370d19bc88cb12cca4539000947b8c08f4d"}
May 25 11:18:09.480546 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:09.480522    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-56c82"
May 25 11:18:09.480736 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:09.480635    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 25 11:18:09.481120 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:09.481105    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-56c82"
May 25 11:18:10.154122 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:10.154091    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:10.154314 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:10.154103    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:10.154314 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:10.154244    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:10.154314 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:10.154287    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:12.154137 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.154108    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:12.154137 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.154123    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:12.154804 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:12.154231    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:12.154804 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:12.154765    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:12.609978 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.609947    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-f2vwp"]
May 25 11:18:12.623413 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.623391    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.627677 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.627472    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6lnl\""
May 25 11:18:12.627794 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.627498    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 11:18:12.627794 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.627539    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 11:18:12.795989 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.795944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-tmp-dir\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.796141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.796003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-hosts-file\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.796141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.796031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfc6r\" (UniqueName: \"kubernetes.io/projected/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-kube-api-access-mfc6r\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.896549 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.896521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-tmp-dir\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.896549 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.896554    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-hosts-file\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.896791 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.896590    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfc6r\" (UniqueName: \"kubernetes.io/projected/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-kube-api-access-mfc6r\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.896791 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.896752    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-hosts-file\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.896895 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.896876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-tmp-dir\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.909716 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.909694    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfc6r\" (UniqueName: \"kubernetes.io/projected/71438de0-c3fa-44f6-b72d-dc3b91b80ad4-kube-api-access-mfc6r\") pod \"node-resolver-f2vwp\" (UID: \"71438de0-c3fa-44f6-b72d-dc3b91b80ad4\") " pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:12.934467 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:12.934438    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2vwp"
May 25 11:18:14.154354 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.154275    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:14.154809 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.154289    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:14.154809 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.154407    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82b7t" podUID="dfe8c912-6fa2-4816-98c3-96899256f4d3"
May 25 11:18:14.154809 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.154495    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgcjm" podUID="f0f7d02a-5617-4d4a-b59d-b992d78b88bb"
May 25 11:18:14.321273 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.321244    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeReady"
May 25 11:18:14.321440 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.321381    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 11:18:14.369289 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.369261    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-897p7"]
May 25 11:18:14.383658 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.383632    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gcr7"]
May 25 11:18:14.383821 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.383803    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.386547 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.386526    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9k5hq\""
May 25 11:18:14.386684 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.386594    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 11:18:14.386684 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.386626    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 11:18:14.391039 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.391020    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-897p7"]
May 25 11:18:14.391140 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.391044    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gcr7"]
May 25 11:18:14.391205 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.391138    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.393730 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.393709    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 11:18:14.393829 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.393736    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kqrg2\""
May 25 11:18:14.393829 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.393784    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 11:18:14.393829 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.393784    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 11:18:14.507880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.507880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlpp\" (UniqueName: \"kubernetes.io/projected/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-kube-api-access-zhlpp\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.507880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-tmp-dir\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.508159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.508159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-config-volume\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.508159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.507989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbc2j\" (UniqueName: \"kubernetes.io/projected/ddfff78b-8247-404c-9c73-4b83efa64b26-kube-api-access-cbc2j\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.608781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.608749    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlpp\" (UniqueName: \"kubernetes.io/projected/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-kube-api-access-zhlpp\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.608956 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.608789    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-tmp-dir\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.608956 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.608807    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.608956 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.608894    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:14.608956 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.608956    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:15.108933881 +0000 UTC m=+34.570989356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:14.609159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.609104    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-config-volume\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.609159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.609151    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbc2j\" (UniqueName: \"kubernetes.io/projected/ddfff78b-8247-404c-9c73-4b83efa64b26-kube-api-access-cbc2j\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.609235 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.609116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-tmp-dir\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.609289 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.609245    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.609377 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.609356    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:14.609449 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.609410    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls podName:0a93a2e3-dfc7-4ff1-a785-ca290b4a95de nodeName:}" failed. No retries permitted until 2026-05-25 11:18:15.10939507 +0000 UTC m=+34.571450561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls") pod "dns-default-897p7" (UID: "0a93a2e3-dfc7-4ff1-a785-ca290b4a95de") : secret "dns-default-metrics-tls" not found
May 25 11:18:14.609605 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.609585    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-config-volume\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.618140 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.618109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlpp\" (UniqueName: \"kubernetes.io/projected/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-kube-api-access-zhlpp\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:14.618256 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.618199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbc2j\" (UniqueName: \"kubernetes.io/projected/ddfff78b-8247-404c-9c73-4b83efa64b26-kube-api-access-cbc2j\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:14.797687 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:14.797649    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71438de0_c3fa_44f6_b72d_dc3b91b80ad4.slice/crio-2178fd78dd88506c4b9598c2e71b6d23d5c6f18c10ee01b20f6039ab234cf037 WatchSource:0}: Error finding container 2178fd78dd88506c4b9598c2e71b6d23d5c6f18c10ee01b20f6039ab234cf037: Status 404 returned error can't find the container with id 2178fd78dd88506c4b9598c2e71b6d23d5c6f18c10ee01b20f6039ab234cf037
May 25 11:18:14.911673 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.911649    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:14.911774 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:14.911703    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:14.911828 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911811    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:18:14.911828 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911821    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:18:14.911925 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911829    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:18:14.911925 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911839    2562 projected.go:194] Error preparing data for projected volume kube-api-access-qbxgc for pod openshift-network-diagnostics/network-check-target-qgcjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:18:14.911925 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs podName:dfe8c912-6fa2-4816-98c3-96899256f4d3 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:46.911863686 +0000 UTC m=+66.373919176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs") pod "network-metrics-daemon-82b7t" (UID: "dfe8c912-6fa2-4816-98c3-96899256f4d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:18:14.911925 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:14.911912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc podName:f0f7d02a-5617-4d4a-b59d-b992d78b88bb nodeName:}" failed. No retries permitted until 2026-05-25 11:18:46.911902545 +0000 UTC m=+66.373958037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbxgc" (UniqueName: "kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc") pod "network-check-target-qgcjm" (UID: "f0f7d02a-5617-4d4a-b59d-b992d78b88bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:18:15.113955 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.113927    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:15.114061 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.114017    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:15.114124 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:15.114104    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:15.114179 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:15.114138    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:15.114287 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:15.114170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:16.114150462 +0000 UTC m=+35.576205948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:15.114345 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:15.114305    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls podName:0a93a2e3-dfc7-4ff1-a785-ca290b4a95de nodeName:}" failed. No retries permitted until 2026-05-25 11:18:16.11428702 +0000 UTC m=+35.576342499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls") pod "dns-default-897p7" (UID: "0a93a2e3-dfc7-4ff1-a785-ca290b4a95de") : secret "dns-default-metrics-tls" not found
May 25 11:18:15.335036 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.335005    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2vwp" event={"ID":"71438de0-c3fa-44f6-b72d-dc3b91b80ad4","Type":"ContainerStarted","Data":"d6d5b686e3a89c5dedfb484fa070e0dc078dd5a0d3d99e1d1ff198d56056da8a"}
May 25 11:18:15.335472 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.335053    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2vwp" event={"ID":"71438de0-c3fa-44f6-b72d-dc3b91b80ad4","Type":"ContainerStarted","Data":"2178fd78dd88506c4b9598c2e71b6d23d5c6f18c10ee01b20f6039ab234cf037"}
May 25 11:18:15.337345 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.337321    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerStarted","Data":"b1a947b5e582de708938d9f7a80708fbbb46c61a917258fe2331dfb4fdad5a23"}
May 25 11:18:15.350237 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:15.350202    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-f2vwp" podStartSLOduration=3.350192138 podStartE2EDuration="3.350192138s" podCreationTimestamp="2026-05-25 11:18:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:18:15.350033934 +0000 UTC m=+34.812089451" watchObservedRunningTime="2026-05-25 11:18:15.350192138 +0000 UTC m=+34.812247627"
May 25 11:18:16.120180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.120149    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:16.120353 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.120194    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:16.120353 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:16.120293    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:16.120353 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:16.120301    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:16.120353 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:16.120349    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:18.120331674 +0000 UTC m=+37.582387165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:16.120512 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:16.120363    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls podName:0a93a2e3-dfc7-4ff1-a785-ca290b4a95de nodeName:}" failed. No retries permitted until 2026-05-25 11:18:18.120357086 +0000 UTC m=+37.582412560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls") pod "dns-default-897p7" (UID: "0a93a2e3-dfc7-4ff1-a785-ca290b4a95de") : secret "dns-default-metrics-tls" not found
May 25 11:18:16.153665 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.153644    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:16.153665 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.153655    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:16.156218 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.156195    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:18:16.156927 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.156912    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:18:16.157238 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.157190    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mcnj6\""
May 25 11:18:16.157238 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.157196    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:18:16.157238 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.157229    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkpxl\""
May 25 11:18:16.341304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.341129    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="b1a947b5e582de708938d9f7a80708fbbb46c61a917258fe2331dfb4fdad5a23" exitCode=0
May 25 11:18:16.341304 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:16.341207    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"b1a947b5e582de708938d9f7a80708fbbb46c61a917258fe2331dfb4fdad5a23"}
May 25 11:18:17.345560 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:17.345530    2562 generic.go:358] "Generic (PLEG): container finished" podID="4f528594-3c6a-46e9-9273-7b35c4b8660f" containerID="1eee48a1dbaba6e403b1ffcb025fab44856187fa79528f78bf834823459c1137" exitCode=0
May 25 11:18:17.345918 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:17.345590    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerDied","Data":"1eee48a1dbaba6e403b1ffcb025fab44856187fa79528f78bf834823459c1137"}
May 25 11:18:18.135342 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:18.135265    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:18.135342 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:18.135313    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:18.135505 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:18.135410    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:18.135505 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:18.135426    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:18.135505 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:18.135459    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:22.135445141 +0000 UTC m=+41.597500614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:18.135505 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:18.135488    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls podName:0a93a2e3-dfc7-4ff1-a785-ca290b4a95de nodeName:}" failed. No retries permitted until 2026-05-25 11:18:22.135469646 +0000 UTC m=+41.597525137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls") pod "dns-default-897p7" (UID: "0a93a2e3-dfc7-4ff1-a785-ca290b4a95de") : secret "dns-default-metrics-tls" not found
May 25 11:18:18.351140 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:18.351109    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dft5z" event={"ID":"4f528594-3c6a-46e9-9273-7b35c4b8660f","Type":"ContainerStarted","Data":"8acbac7cafcd573ce0b54e1bc93da2f2c28f088ae01357bde0e22c114a9ab67e"}
May 25 11:18:19.905612 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.905549    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dft5z" podStartSLOduration=7.611658049 podStartE2EDuration="38.905534456s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:17:43.785384365 +0000 UTC m=+3.247439838" lastFinishedPulling="2026-05-25 11:18:15.079260754 +0000 UTC m=+34.541316245" observedRunningTime="2026-05-25 11:18:18.463297472 +0000 UTC m=+37.925352970" watchObservedRunningTime="2026-05-25 11:18:19.905534456 +0000 UTC m=+39.367589951"
May 25 11:18:19.906022 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.905965    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"]
May 25 11:18:19.907757 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.907742    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"
May 25 11:18:19.910517 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.910498    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 25 11:18:19.911370 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.911351    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pb4zh\""
May 25 11:18:19.911425 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.911405    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 25 11:18:19.921242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.921215    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"]
May 25 11:18:19.948889 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:19.948860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8wx\" (UniqueName: \"kubernetes.io/projected/cd364f40-faa0-4e65-ae28-685a6fcff189-kube-api-access-wf8wx\") pod \"migrator-b985f5d89-f52ct\" (UID: \"cd364f40-faa0-4e65-ae28-685a6fcff189\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"
May 25 11:18:20.049552 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.049525    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8wx\" (UniqueName: \"kubernetes.io/projected/cd364f40-faa0-4e65-ae28-685a6fcff189-kube-api-access-wf8wx\") pod \"migrator-b985f5d89-f52ct\" (UID: \"cd364f40-faa0-4e65-ae28-685a6fcff189\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"
May 25 11:18:20.062051 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.062026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8wx\" (UniqueName: \"kubernetes.io/projected/cd364f40-faa0-4e65-ae28-685a6fcff189-kube-api-access-wf8wx\") pod \"migrator-b985f5d89-f52ct\" (UID: \"cd364f40-faa0-4e65-ae28-685a6fcff189\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"
May 25 11:18:20.216480 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.216415    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"
May 25 11:18:20.371029 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.371003    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct"]
May 25 11:18:20.374378 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:20.374352    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd364f40_faa0_4e65_ae28_685a6fcff189.slice/crio-72e842c738683a9050053efdc02dbc6b75d6f6346f9c2821686bffed333ef1c9 WatchSource:0}: Error finding container 72e842c738683a9050053efdc02dbc6b75d6f6346f9c2821686bffed333ef1c9: Status 404 returned error can't find the container with id 72e842c738683a9050053efdc02dbc6b75d6f6346f9c2821686bffed333ef1c9
May 25 11:18:20.478155 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.478101    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2vwp_71438de0-c3fa-44f6-b72d-dc3b91b80ad4/dns-node-resolver/0.log"
May 25 11:18:20.696243 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.696211    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"]
May 25 11:18:20.702452 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.702433    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"
May 25 11:18:20.705371 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.705351    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bqg5s\""
May 25 11:18:20.713349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.713331    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"]
May 25 11:18:20.754798 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.754743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfxlf\" (UniqueName: \"kubernetes.io/projected/6952c1d8-2ef0-4ab5-b856-f5b56a884167-kube-api-access-tfxlf\") pod \"network-check-source-7f44b6dd87-9lllh\" (UID: \"6952c1d8-2ef0-4ab5-b856-f5b56a884167\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"
May 25 11:18:20.855632 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.855600    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfxlf\" (UniqueName: \"kubernetes.io/projected/6952c1d8-2ef0-4ab5-b856-f5b56a884167-kube-api-access-tfxlf\") pod \"network-check-source-7f44b6dd87-9lllh\" (UID: \"6952c1d8-2ef0-4ab5-b856-f5b56a884167\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"
May 25 11:18:20.870921 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:20.870898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfxlf\" (UniqueName: \"kubernetes.io/projected/6952c1d8-2ef0-4ab5-b856-f5b56a884167-kube-api-access-tfxlf\") pod \"network-check-source-7f44b6dd87-9lllh\" (UID: \"6952c1d8-2ef0-4ab5-b856-f5b56a884167\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"
May 25 11:18:21.010985 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:21.010921    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"
May 25 11:18:21.158767 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:21.158738    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh"]
May 25 11:18:21.341090 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:21.341058    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6952c1d8_2ef0_4ab5_b856_f5b56a884167.slice/crio-5727071be237fbc4ac1415a49ce0cd3fd8e4a3b2391403c67ea7272898be627e WatchSource:0}: Error finding container 5727071be237fbc4ac1415a49ce0cd3fd8e4a3b2391403c67ea7272898be627e: Status 404 returned error can't find the container with id 5727071be237fbc4ac1415a49ce0cd3fd8e4a3b2391403c67ea7272898be627e
May 25 11:18:21.358496 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:21.358471    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh" event={"ID":"6952c1d8-2ef0-4ab5-b856-f5b56a884167","Type":"ContainerStarted","Data":"5727071be237fbc4ac1415a49ce0cd3fd8e4a3b2391403c67ea7272898be627e"}
May 25 11:18:21.359397 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:21.359374    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct" event={"ID":"cd364f40-faa0-4e65-ae28-685a6fcff189","Type":"ContainerStarted","Data":"72e842c738683a9050053efdc02dbc6b75d6f6346f9c2821686bffed333ef1c9"}
May 25 11:18:21.476927 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:21.476906    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j6f2b_74897e03-4185-4a7e-ac3e-2be15c3ee545/node-ca/0.log"
May 25 11:18:22.164795 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:22.164755    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:22.165235 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:22.164851    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:22.165235 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:22.164901    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:22.165235 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:22.164972    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:18:22.165235 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:22.164977    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:30.164960955 +0000 UTC m=+49.627016435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:22.165235 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:22.165030    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls podName:0a93a2e3-dfc7-4ff1-a785-ca290b4a95de nodeName:}" failed. No retries permitted until 2026-05-25 11:18:30.165015536 +0000 UTC m=+49.627071017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls") pod "dns-default-897p7" (UID: "0a93a2e3-dfc7-4ff1-a785-ca290b4a95de") : secret "dns-default-metrics-tls" not found
May 25 11:18:22.363236 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:22.363206    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct" event={"ID":"cd364f40-faa0-4e65-ae28-685a6fcff189","Type":"ContainerStarted","Data":"052d0549c8c9072adfe532002948c0bcd57d5d32d919a26146399533073da879"}
May 25 11:18:22.363236 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:22.363244    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct" event={"ID":"cd364f40-faa0-4e65-ae28-685a6fcff189","Type":"ContainerStarted","Data":"e02869fb1a325e01d2447e8fd5a72edc495c30c20854a55c0ff4008c9279c694"}
May 25 11:18:22.382894 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:22.382850    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-f52ct" podStartSLOduration=2.395101453 podStartE2EDuration="3.382837143s" podCreationTimestamp="2026-05-25 11:18:19 +0000 UTC" firstStartedPulling="2026-05-25 11:18:20.376670668 +0000 UTC m=+39.838726142" lastFinishedPulling="2026-05-25 11:18:21.364406355 +0000 UTC m=+40.826461832" observedRunningTime="2026-05-25 11:18:22.381156855 +0000 UTC m=+41.843212351" watchObservedRunningTime="2026-05-25 11:18:22.382837143 +0000 UTC m=+41.844892638"
May 25 11:18:24.369288 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:24.369252    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh" event={"ID":"6952c1d8-2ef0-4ab5-b856-f5b56a884167","Type":"ContainerStarted","Data":"b707f60d2471d387e5cec3cb9acece9d84cf65a774f939b141f6f2b5e06a7a9b"}
May 25 11:18:24.388338 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:24.388210    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9lllh" podStartSLOduration=1.815155428 podStartE2EDuration="4.388198207s" podCreationTimestamp="2026-05-25 11:18:20 +0000 UTC" firstStartedPulling="2026-05-25 11:18:21.342938958 +0000 UTC m=+40.804994432" lastFinishedPulling="2026-05-25 11:18:23.915981725 +0000 UTC m=+43.378037211" observedRunningTime="2026-05-25 11:18:24.388168341 +0000 UTC m=+43.850223838" watchObservedRunningTime="2026-05-25 11:18:24.388198207 +0000 UTC m=+43.850253700"
May 25 11:18:30.220325 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:30.220286    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:30.220903 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:30.220356    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:30.220903 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:30.220490    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:18:30.220903 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:30.220591    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert podName:ddfff78b-8247-404c-9c73-4b83efa64b26 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:46.220550417 +0000 UTC m=+65.682605911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert") pod "ingress-canary-8gcr7" (UID: "ddfff78b-8247-404c-9c73-4b83efa64b26") : secret "canary-serving-cert" not found
May 25 11:18:30.222700 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:30.222678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a93a2e3-dfc7-4ff1-a785-ca290b4a95de-metrics-tls\") pod \"dns-default-897p7\" (UID: \"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de\") " pod="openshift-dns/dns-default-897p7"
May 25 11:18:30.297905 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:30.297878    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-897p7"
May 25 11:18:30.421396 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:30.421368    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-897p7"]
May 25 11:18:30.424556 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:30.424523    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a93a2e3_dfc7_4ff1_a785_ca290b4a95de.slice/crio-34ffc3352e3e1fdc7266c61070b8e707ac04474d60b20ad56108586d88bca782 WatchSource:0}: Error finding container 34ffc3352e3e1fdc7266c61070b8e707ac04474d60b20ad56108586d88bca782: Status 404 returned error can't find the container with id 34ffc3352e3e1fdc7266c61070b8e707ac04474d60b20ad56108586d88bca782
May 25 11:18:31.384642 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:31.384604    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-897p7" event={"ID":"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de","Type":"ContainerStarted","Data":"34ffc3352e3e1fdc7266c61070b8e707ac04474d60b20ad56108586d88bca782"}
May 25 11:18:32.388768 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:32.388732    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-897p7" event={"ID":"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de","Type":"ContainerStarted","Data":"ac554a13d7f15e1ec2188f053442df0aa30cf2d284791a7063edcadebb15e618"}
May 25 11:18:32.388768 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:32.388768    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-897p7" event={"ID":"0a93a2e3-dfc7-4ff1-a785-ca290b4a95de","Type":"ContainerStarted","Data":"f795c3dadacd66865ed7df593ef48ed6c9d4657e9ae44e73a766c27aaa4c1228"}
May 25 11:18:33.390882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:33.390855    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-897p7"
May 25 11:18:33.421612 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:33.421551    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-897p7" podStartSLOduration=17.744426592 podStartE2EDuration="19.421537612s" podCreationTimestamp="2026-05-25 11:18:14 +0000 UTC" firstStartedPulling="2026-05-25 11:18:30.426727285 +0000 UTC m=+49.888782769" lastFinishedPulling="2026-05-25 11:18:32.103838309 +0000 UTC m=+51.565893789" observedRunningTime="2026-05-25 11:18:33.421500898 +0000 UTC m=+52.883556394" watchObservedRunningTime="2026-05-25 11:18:33.421537612 +0000 UTC m=+52.883593144"
May 25 11:18:40.336131 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:40.336103    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25sdt"
May 25 11:18:43.395301 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:43.395268    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-897p7"
May 25 11:18:45.007505 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.007475    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hk4wc"]
May 25 11:18:45.009995 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.009973    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.013218 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.013199    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 11:18:45.014173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.014152    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m9btq\""
May 25 11:18:45.014270 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.014223    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 11:18:45.014270 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.014230    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 11:18:45.014270 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.014237    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 11:18:45.024433 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.024409    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk4wc"]
May 25 11:18:45.123341 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.123315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6892da71-f116-43b0-8fab-7bc21a290750-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.123444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.123349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8nr4\" (UniqueName: \"kubernetes.io/projected/6892da71-f116-43b0-8fab-7bc21a290750-kube-api-access-k8nr4\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.123444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.123380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6892da71-f116-43b0-8fab-7bc21a290750-crio-socket\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.123444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.123411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6892da71-f116-43b0-8fab-7bc21a290750-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.123444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.123436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6892da71-f116-43b0-8fab-7bc21a290750-data-volume\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.128998 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.128976    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"]
May 25 11:18:45.130642 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.130629    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.141506 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.141490    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 25 11:18:45.141654 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.141630    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 25 11:18:45.141654 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.141634    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 25 11:18:45.141853 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.141833    2562 status_manager.go:895] "Failed to get status for pod" podUID="ca29321f-bbd5-495f-933e-a3cbfa43a25d" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4" err="pods \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object"
May 25 11:18:45.152822 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.152801    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 25 11:18:45.167995 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.167970    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-649d68c55b-9m65g"]
May 25 11:18:45.169875 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.169851    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"]
May 25 11:18:45.169980 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.169968    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.178279 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.178262    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 11:18:45.178502 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.178487    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 11:18:45.178541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.178487    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lh8tr\""
May 25 11:18:45.179253 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.179240    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 11:18:45.196629 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.196607    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 11:18:45.215823 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.215806    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649d68c55b-9m65g"]
May 25 11:18:45.224480 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224560 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224560 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224560 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224676 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224589    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6892da71-f116-43b0-8fab-7bc21a290750-data-volume\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224676 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224676 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fm6p\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224683    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6892da71-f116-43b0-8fab-7bc21a290750-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca29321f-bbd5-495f-933e-a3cbfa43a25d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.224762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8nr4\" (UniqueName: \"kubernetes.io/projected/6892da71-f116-43b0-8fab-7bc21a290750-kube-api-access-k8nr4\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.224884 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224798    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6892da71-f116-43b0-8fab-7bc21a290750-crio-socket\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224884 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224834    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6892da71-f116-43b0-8fab-7bc21a290750-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224884 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6892da71-f116-43b0-8fab-7bc21a290750-data-volume\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.224884 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca29321f-bbd5-495f-933e-a3cbfa43a25d-tmp\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.225021 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbs4n\" (UniqueName: \"kubernetes.io/projected/ca29321f-bbd5-495f-933e-a3cbfa43a25d-kube-api-access-lbs4n\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.225021 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.224913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.225088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.225033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6892da71-f116-43b0-8fab-7bc21a290750-crio-socket\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.225170 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.225155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6892da71-f116-43b0-8fab-7bc21a290750-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.227048 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.227028    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6892da71-f116-43b0-8fab-7bc21a290750-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.239937 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.239914    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-2kdlf"]
May 25 11:18:45.244037 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.244016    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:18:45.246707 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.246690    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 11:18:45.247057 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.247042    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b5f57\""
May 25 11:18:45.249247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.249226    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 11:18:45.252933 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.252908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8nr4\" (UniqueName: \"kubernetes.io/projected/6892da71-f116-43b0-8fab-7bc21a290750-kube-api-access-k8nr4\") pod \"insights-runtime-extractor-hk4wc\" (UID: \"6892da71-f116-43b0-8fab-7bc21a290750\") " pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.265595 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.265532    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-2kdlf"]
May 25 11:18:45.287422 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.287399    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-649d68c55b-9m65g"]
May 25 11:18:45.287547 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:45.287530    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-4fm6p registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-649d68c55b-9m65g" podUID="8d520c44-0508-40e1-ac66-aed56a4e1808"
May 25 11:18:45.318814 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.318790    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk4wc"
May 25 11:18:45.325592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.325592 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325583    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fm6p\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.325674 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325612    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca29321f-bbd5-495f-933e-a3cbfa43a25d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.325674 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325630    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.325674 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh8d2\" (UniqueName: \"kubernetes.io/projected/54402251-5654-43de-a856-2235e74c9d00-kube-api-access-wh8d2\") pod \"downloads-57bd96b888-2kdlf\" (UID: \"54402251-5654-43de-a856-2235e74c9d00\") " pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:18:45.325812 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325716    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca29321f-bbd5-495f-933e-a3cbfa43a25d-tmp\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.325812 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325740    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbs4n\" (UniqueName: \"kubernetes.io/projected/ca29321f-bbd5-495f-933e-a3cbfa43a25d-kube-api-access-lbs4n\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.325812 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325764    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.325812 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325794    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.326004 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325817    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.326004 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.326004 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.325874    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.326182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.326143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca29321f-bbd5-495f-933e-a3cbfa43a25d-tmp\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.326599 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.326557    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.326758 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.326736    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.327054 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.327027    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.329027 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.328984    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.329027 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.328994    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.329283 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.329262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca29321f-bbd5-495f-933e-a3cbfa43a25d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.329578 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.329545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.340882 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.340858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fm6p\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.343041 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.343024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token\") pod \"image-registry-649d68c55b-9m65g\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") " pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.348192 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.348171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbs4n\" (UniqueName: \"kubernetes.io/projected/ca29321f-bbd5-495f-933e-a3cbfa43a25d-kube-api-access-lbs4n\") pod \"klusterlet-addon-workmgr-f9b95995f-9p6w4\" (UID: \"ca29321f-bbd5-495f-933e-a3cbfa43a25d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.413814 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.413784    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.418762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.418741    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:45.427116 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.427095    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wh8d2\" (UniqueName: \"kubernetes.io/projected/54402251-5654-43de-a856-2235e74c9d00-kube-api-access-wh8d2\") pod \"downloads-57bd96b888-2kdlf\" (UID: \"54402251-5654-43de-a856-2235e74c9d00\") " pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:18:45.438528 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.438508    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:45.450249 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.450231    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh8d2\" (UniqueName: \"kubernetes.io/projected/54402251-5654-43de-a856-2235e74c9d00-kube-api-access-wh8d2\") pod \"downloads-57bd96b888-2kdlf\" (UID: \"54402251-5654-43de-a856-2235e74c9d00\") " pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:18:45.470623 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.470598    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk4wc"]
May 25 11:18:45.471200 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:45.471170    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6892da71_f116_43b0_8fab_7bc21a290750.slice/crio-9e6d1b3e4b35b0532850694f12252cf2fb43d774e15eb94bd94767a82f354143 WatchSource:0}: Error finding container 9e6d1b3e4b35b0532850694f12252cf2fb43d774e15eb94bd94767a82f354143: Status 404 returned error can't find the container with id 9e6d1b3e4b35b0532850694f12252cf2fb43d774e15eb94bd94767a82f354143
May 25 11:18:45.527661 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527631    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527777 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527682    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fm6p\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527777 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527734    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527777 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527765    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527938 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527807    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527938 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527854    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527938 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527884    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.527938 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.527911    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration\") pod \"8d520c44-0508-40e1-ac66-aed56a4e1808\" (UID: \"8d520c44-0508-40e1-ac66-aed56a4e1808\") "
May 25 11:18:45.528344 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.528316    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:18:45.529512 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.528538    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:18:45.529512 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.528739    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d520c44-0508-40e1-ac66-aed56a4e1808-ca-trust-extracted\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.529512 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.528761    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-certificates\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.529512 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.528821    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:18:45.531693 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.531669    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:18:45.531693 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.531681    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p" (OuterVolumeSpecName: "kube-api-access-4fm6p") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "kube-api-access-4fm6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:18:45.531867 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.531709    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:18:45.533007 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.532977    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:18:45.533280 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.533256    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8d520c44-0508-40e1-ac66-aed56a4e1808" (UID: "8d520c44-0508-40e1-ac66-aed56a4e1808"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:18:45.552390 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.552367    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:18:45.573743 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.573718    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"]
May 25 11:18:45.578936 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:45.578911    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29321f_bbd5_495f_933e_a3cbfa43a25d.slice/crio-1a5dd493f3803186413ea84096710f0c2a021a6c6238ba6c33cc6ba56b9ceb54 WatchSource:0}: Error finding container 1a5dd493f3803186413ea84096710f0c2a021a6c6238ba6c33cc6ba56b9ceb54: Status 404 returned error can't find the container with id 1a5dd493f3803186413ea84096710f0c2a021a6c6238ba6c33cc6ba56b9ceb54
May 25 11:18:45.630154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630128    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-registry-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630160    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-image-registry-private-configuration\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630176    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-bound-sa-token\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630190    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fm6p\" (UniqueName: \"kubernetes.io/projected/8d520c44-0508-40e1-ac66-aed56a4e1808-kube-api-access-4fm6p\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630205    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d520c44-0508-40e1-ac66-aed56a4e1808-installation-pull-secrets\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.630218    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d520c44-0508-40e1-ac66-aed56a4e1808-trusted-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:18:45.676332 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:45.676307    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-2kdlf"]
May 25 11:18:45.679345 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:45.679323    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54402251_5654_43de_a856_2235e74c9d00.slice/crio-e35619acbfe8a89eb9e0fd7de8ceae214e74b81ea26f666f81aee0731a435019 WatchSource:0}: Error finding container e35619acbfe8a89eb9e0fd7de8ceae214e74b81ea26f666f81aee0731a435019: Status 404 returned error can't find the container with id e35619acbfe8a89eb9e0fd7de8ceae214e74b81ea26f666f81aee0731a435019
May 25 11:18:46.234807 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.234774    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:46.239254 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.239206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddfff78b-8247-404c-9c73-4b83efa64b26-cert\") pod \"ingress-canary-8gcr7\" (UID: \"ddfff78b-8247-404c-9c73-4b83efa64b26\") " pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:46.417754 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.417672    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4" event={"ID":"ca29321f-bbd5-495f-933e-a3cbfa43a25d","Type":"ContainerStarted","Data":"1a5dd493f3803186413ea84096710f0c2a021a6c6238ba6c33cc6ba56b9ceb54"}
May 25 11:18:46.418927 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.418897    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-2kdlf" event={"ID":"54402251-5654-43de-a856-2235e74c9d00","Type":"ContainerStarted","Data":"e35619acbfe8a89eb9e0fd7de8ceae214e74b81ea26f666f81aee0731a435019"}
May 25 11:18:46.421167 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.420611    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649d68c55b-9m65g"
May 25 11:18:46.421167 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.420888    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk4wc" event={"ID":"6892da71-f116-43b0-8fab-7bc21a290750","Type":"ContainerStarted","Data":"0934bcc48e1c39fd126ec6b97e13157ac776a957fbd12ed1cc50ecfe0b618b70"}
May 25 11:18:46.421167 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.420927    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk4wc" event={"ID":"6892da71-f116-43b0-8fab-7bc21a290750","Type":"ContainerStarted","Data":"b35a95341e239102a4e898080716fb71c1e700981491d68b62d9ef3bfbde38f9"}
May 25 11:18:46.421167 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.420942    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk4wc" event={"ID":"6892da71-f116-43b0-8fab-7bc21a290750","Type":"ContainerStarted","Data":"9e6d1b3e4b35b0532850694f12252cf2fb43d774e15eb94bd94767a82f354143"}
May 25 11:18:46.463935 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.462075    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-649d68c55b-9m65g"]
May 25 11:18:46.468238 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.465848    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-649d68c55b-9m65g"]
May 25 11:18:46.509216 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.509191    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kqrg2\""
May 25 11:18:46.517294 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.517264    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gcr7"
May 25 11:18:46.689504 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.689404    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gcr7"]
May 25 11:18:46.695940 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:46.695905    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfff78b_8247_404c_9c73_4b83efa64b26.slice/crio-a363ba6978d5a26a7f227a405b23c1568689f20b747d3ea3ff2b2dd851e19812 WatchSource:0}: Error finding container a363ba6978d5a26a7f227a405b23c1568689f20b747d3ea3ff2b2dd851e19812: Status 404 returned error can't find the container with id a363ba6978d5a26a7f227a405b23c1568689f20b747d3ea3ff2b2dd851e19812
May 25 11:18:46.941747 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.941666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:46.941747 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.941736    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:46.944880 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.944856    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:18:46.947798 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.947744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxgc\" (UniqueName: \"kubernetes.io/projected/f0f7d02a-5617-4d4a-b59d-b992d78b88bb-kube-api-access-qbxgc\") pod \"network-check-target-qgcjm\" (UID: \"f0f7d02a-5617-4d4a-b59d-b992d78b88bb\") " pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:46.955305 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:46.955260    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe8c912-6fa2-4816-98c3-96899256f4d3-metrics-certs\") pod \"network-metrics-daemon-82b7t\" (UID: \"dfe8c912-6fa2-4816-98c3-96899256f4d3\") " pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:47.065936 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.065897    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mcnj6\""
May 25 11:18:47.072132 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.072108    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkpxl\""
May 25 11:18:47.074311 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.074211    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:47.077666 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.077256    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82b7t"
May 25 11:18:47.167765 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.166149    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d520c44-0508-40e1-ac66-aed56a4e1808" path="/var/lib/kubelet/pods/8d520c44-0508-40e1-ac66-aed56a4e1808/volumes"
May 25 11:18:47.271074 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.270337    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgcjm"]
May 25 11:18:47.288638 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.288611    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82b7t"]
May 25 11:18:47.426456 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.426414    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gcr7" event={"ID":"ddfff78b-8247-404c-9c73-4b83efa64b26","Type":"ContainerStarted","Data":"a363ba6978d5a26a7f227a405b23c1568689f20b747d3ea3ff2b2dd851e19812"}
May 25 11:18:47.615137 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.615107    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:18:47.617405 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.617382    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.622198 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622177    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 11:18:47.622464 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622444    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 11:18:47.622548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622492    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hcjk4\""
May 25 11:18:47.622647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622632    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 11:18:47.622710 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622678    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 11:18:47.622710 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.622699    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 11:18:47.633229 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.633140    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:18:47.748154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.748154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.748407 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.748407 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.748407 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.748407 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.748265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzm8\" (UniqueName: \"kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849093    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849142    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849203    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzm8\" (UniqueName: \"kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849261    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.849290    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.850088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.850041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.852092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.851024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.852092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.852038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.854727 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.854686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.856840 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.856799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.866255 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.866183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzm8\" (UniqueName: \"kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8\") pod \"console-7f67b8889b-j6ghs\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") " pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:47.933277 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:47.931990    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:49.120318 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:49.120273    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f7d02a_5617_4d4a_b59d_b992d78b88bb.slice/crio-d44588006ec4eac163bc62c3d63f7113ab9f9935bdb9bd7743599c70711731eb WatchSource:0}: Error finding container d44588006ec4eac163bc62c3d63f7113ab9f9935bdb9bd7743599c70711731eb: Status 404 returned error can't find the container with id d44588006ec4eac163bc62c3d63f7113ab9f9935bdb9bd7743599c70711731eb
May 25 11:18:49.120879 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:49.120846    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe8c912_6fa2_4816_98c3_96899256f4d3.slice/crio-1aad47efd32c680e0f77ce4371afa8b209666b64aae8f5863495f2dba2b778bc WatchSource:0}: Error finding container 1aad47efd32c680e0f77ce4371afa8b209666b64aae8f5863495f2dba2b778bc: Status 404 returned error can't find the container with id 1aad47efd32c680e0f77ce4371afa8b209666b64aae8f5863495f2dba2b778bc
May 25 11:18:49.434123 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:49.434023    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgcjm" event={"ID":"f0f7d02a-5617-4d4a-b59d-b992d78b88bb","Type":"ContainerStarted","Data":"d44588006ec4eac163bc62c3d63f7113ab9f9935bdb9bd7743599c70711731eb"}
May 25 11:18:49.435404 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:49.435371    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82b7t" event={"ID":"dfe8c912-6fa2-4816-98c3-96899256f4d3","Type":"ContainerStarted","Data":"1aad47efd32c680e0f77ce4371afa8b209666b64aae8f5863495f2dba2b778bc"}
May 25 11:18:51.665982 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.658426    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"]
May 25 11:18:51.665982 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.664493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:51.674783 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.667628    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7s8l8\""
May 25 11:18:51.674783 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.668183    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 11:18:51.684001 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.680539    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"]
May 25 11:18:51.770702 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.769440    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:18:51.775145 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:51.775110    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9796eaf_96e8_49a2_b8d4_ab0ed98a5cde.slice/crio-378841291ff4f0321aff38a5d4d393ad3993494d4fcebef6760caf151154cf3c WatchSource:0}: Error finding container 378841291ff4f0321aff38a5d4d393ad3993494d4fcebef6760caf151154cf3c: Status 404 returned error can't find the container with id 378841291ff4f0321aff38a5d4d393ad3993494d4fcebef6760caf151154cf3c
May 25 11:18:51.781398 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.781356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg\" (UID: \"249f7d7d-115c-43d1-980e-897af66480b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:51.883218 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:51.882860    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg\" (UID: \"249f7d7d-115c-43d1-980e-897af66480b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:51.883218 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:51.883027    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 25 11:18:51.883218 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:51.883091    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates podName:249f7d7d-115c-43d1-980e-897af66480b3 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:52.383070429 +0000 UTC m=+71.845125916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg" (UID: "249f7d7d-115c-43d1-980e-897af66480b3") : secret "prometheus-operator-admission-webhook-tls" not found
May 25 11:18:52.386951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.386924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg\" (UID: \"249f7d7d-115c-43d1-980e-897af66480b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:52.389683 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.389641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/249f7d7d-115c-43d1-980e-897af66480b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg\" (UID: \"249f7d7d-115c-43d1-980e-897af66480b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:52.449317 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.449240    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk4wc" event={"ID":"6892da71-f116-43b0-8fab-7bc21a290750","Type":"ContainerStarted","Data":"eb1ffaaedcc8985495aeb75d9e93ad7487ef5e3b6972f7b30cd5257196458885"}
May 25 11:18:52.451308 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.451065    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4" event={"ID":"ca29321f-bbd5-495f-933e-a3cbfa43a25d","Type":"ContainerStarted","Data":"5eea98164e00c262bac53f34bc0c1f6329adb35243612d3d26e1eae2af1a968c"}
May 25 11:18:52.451665 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.451649    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:52.452935 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.452890    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67b8889b-j6ghs" event={"ID":"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde","Type":"ContainerStarted","Data":"378841291ff4f0321aff38a5d4d393ad3993494d4fcebef6760caf151154cf3c"}
May 25 11:18:52.453647 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.453459    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4"
May 25 11:18:52.455988 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.455867    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgcjm" event={"ID":"f0f7d02a-5617-4d4a-b59d-b992d78b88bb","Type":"ContainerStarted","Data":"ea0ff1d9bcefcec8fffeaea9b78cfa681bb86650c21470da8192dd74c7bd16d2"}
May 25 11:18:52.456104 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.456022    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:18:52.458322 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.458099    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gcr7" event={"ID":"ddfff78b-8247-404c-9c73-4b83efa64b26","Type":"ContainerStarted","Data":"15904ad6d8e426987f99894a821d3be80be41ed2db11303fdfbe21391a302239"}
May 25 11:18:52.459449 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.459427    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82b7t" event={"ID":"dfe8c912-6fa2-4816-98c3-96899256f4d3","Type":"ContainerStarted","Data":"2ef6ee7b21f212b05eeedb419a235cf411a0bf8f3a8f4c5b22cdfc63b5004baf"}
May 25 11:18:52.471527 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.471458    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hk4wc" podStartSLOduration=2.429670375 podStartE2EDuration="8.471442444s" podCreationTimestamp="2026-05-25 11:18:44 +0000 UTC" firstStartedPulling="2026-05-25 11:18:45.521408657 +0000 UTC m=+64.983464132" lastFinishedPulling="2026-05-25 11:18:51.563180712 +0000 UTC m=+71.025236201" observedRunningTime="2026-05-25 11:18:52.469351901 +0000 UTC m=+71.931407399" watchObservedRunningTime="2026-05-25 11:18:52.471442444 +0000 UTC m=+71.933497941"
May 25 11:18:52.493387 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.493219    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gcr7" podStartSLOduration=33.624422657 podStartE2EDuration="38.493202153s" podCreationTimestamp="2026-05-25 11:18:14 +0000 UTC" firstStartedPulling="2026-05-25 11:18:46.699724507 +0000 UTC m=+66.161779986" lastFinishedPulling="2026-05-25 11:18:51.568503985 +0000 UTC m=+71.030559482" observedRunningTime="2026-05-25 11:18:52.490821959 +0000 UTC m=+71.952877456" watchObservedRunningTime="2026-05-25 11:18:52.493202153 +0000 UTC m=+71.955257653"
May 25 11:18:52.542966 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.542887    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qgcjm" podStartSLOduration=71.542868731 podStartE2EDuration="1m11.542868731s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:18:52.541396489 +0000 UTC m=+72.003451985" watchObservedRunningTime="2026-05-25 11:18:52.542868731 +0000 UTC m=+72.004924227"
May 25 11:18:52.543137 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.543093    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9b95995f-9p6w4" podStartSLOduration=1.546745737 podStartE2EDuration="7.543084517s" podCreationTimestamp="2026-05-25 11:18:45 +0000 UTC" firstStartedPulling="2026-05-25 11:18:45.580220661 +0000 UTC m=+65.042276138" lastFinishedPulling="2026-05-25 11:18:51.57655943 +0000 UTC m=+71.038614918" observedRunningTime="2026-05-25 11:18:52.516973856 +0000 UTC m=+71.979029355" watchObservedRunningTime="2026-05-25 11:18:52.543084517 +0000 UTC m=+72.005140015"
May 25 11:18:52.588965 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.588886    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:52.743485 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:52.743432    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"]
May 25 11:18:52.746812 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:18:52.746775    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f7d7d_115c_43d1_980e_897af66480b3.slice/crio-54a264483325150683e5c66fe6c716ba0c1e42bdb7d070af624b7b7de5546fc2 WatchSource:0}: Error finding container 54a264483325150683e5c66fe6c716ba0c1e42bdb7d070af624b7b7de5546fc2: Status 404 returned error can't find the container with id 54a264483325150683e5c66fe6c716ba0c1e42bdb7d070af624b7b7de5546fc2
May 25 11:18:53.465973 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:53.465932    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82b7t" event={"ID":"dfe8c912-6fa2-4816-98c3-96899256f4d3","Type":"ContainerStarted","Data":"2a50ccc5078e0513cf48690cb4f38983960c2f5a66d19bb6d904b626ab2aacc4"}
May 25 11:18:53.469139 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:53.468912    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg" event={"ID":"249f7d7d-115c-43d1-980e-897af66480b3","Type":"ContainerStarted","Data":"54a264483325150683e5c66fe6c716ba0c1e42bdb7d070af624b7b7de5546fc2"}
May 25 11:18:53.483236 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:53.483168    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82b7t" podStartSLOduration=69.308925202 podStartE2EDuration="1m12.483152235s" podCreationTimestamp="2026-05-25 11:17:41 +0000 UTC" firstStartedPulling="2026-05-25 11:18:49.123011938 +0000 UTC m=+68.585067416" lastFinishedPulling="2026-05-25 11:18:52.297238972 +0000 UTC m=+71.759294449" observedRunningTime="2026-05-25 11:18:53.482626982 +0000 UTC m=+72.944682481" watchObservedRunningTime="2026-05-25 11:18:53.483152235 +0000 UTC m=+72.945207728"
May 25 11:18:55.475960 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.475844    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67b8889b-j6ghs" event={"ID":"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde","Type":"ContainerStarted","Data":"0ecec13530df05cc0756d240e7aa09286162f74c60d62ce4037cedcb00f602b3"}
May 25 11:18:55.477642 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.477615    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg" event={"ID":"249f7d7d-115c-43d1-980e-897af66480b3","Type":"ContainerStarted","Data":"421d06687649f69ab11d4a4e54bfa2348fbdf71d62a74cc6285e4e0216815b12"}
May 25 11:18:55.477856 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.477835    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:55.483667 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.483645    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg"
May 25 11:18:55.497604 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.497542    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f67b8889b-j6ghs" podStartSLOduration=5.226101775 podStartE2EDuration="8.497528949s" podCreationTimestamp="2026-05-25 11:18:47 +0000 UTC" firstStartedPulling="2026-05-25 11:18:51.777654756 +0000 UTC m=+71.239710247" lastFinishedPulling="2026-05-25 11:18:55.04908193 +0000 UTC m=+74.511137421" observedRunningTime="2026-05-25 11:18:55.496248744 +0000 UTC m=+74.958304240" watchObservedRunningTime="2026-05-25 11:18:55.497528949 +0000 UTC m=+74.959584446"
May 25 11:18:55.511709 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.511647    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg" podStartSLOduration=2.238401513 podStartE2EDuration="4.511632998s" podCreationTimestamp="2026-05-25 11:18:51 +0000 UTC" firstStartedPulling="2026-05-25 11:18:52.749347857 +0000 UTC m=+72.211403335" lastFinishedPulling="2026-05-25 11:18:55.022579339 +0000 UTC m=+74.484634820" observedRunningTime="2026-05-25 11:18:55.511184331 +0000 UTC m=+74.973239829" watchObservedRunningTime="2026-05-25 11:18:55.511632998 +0000 UTC m=+74.973688495"
May 25 11:18:55.727521 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.727447    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"]
May 25 11:18:55.733689 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.733660    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.736970 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.736943    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 11:18:55.737109 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.736970    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z6ffs\""
May 25 11:18:55.737109 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.737002    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 11:18:55.737109 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.736972    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 11:18:55.737109 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.737033    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 11:18:55.737109 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.736945    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 11:18:55.740940 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.740916    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"]
May 25 11:18:55.817993 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.817960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tff6v\" (UniqueName: \"kubernetes.io/projected/79402102-2910-425c-94f0-c1c9fea87f70-kube-api-access-tff6v\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.818165 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.818023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79402102-2910-425c-94f0-c1c9fea87f70-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.818165 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.818087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.818165 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.818133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.918876 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.918842    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79402102-2910-425c-94f0-c1c9fea87f70-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.919017 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.918889    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.919017 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.918913    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.919017 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.918946    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tff6v\" (UniqueName: \"kubernetes.io/projected/79402102-2910-425c-94f0-c1c9fea87f70-kube-api-access-tff6v\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.919175 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:55.919084    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 25 11:18:55.919175 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:18:55.919166    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls podName:79402102-2910-425c-94f0-c1c9fea87f70 nodeName:}" failed. No retries permitted until 2026-05-25 11:18:56.419144257 +0000 UTC m=+75.881199755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-lq5kb" (UID: "79402102-2910-425c-94f0-c1c9fea87f70") : secret "prometheus-operator-tls" not found
May 25 11:18:55.919617 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.919587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79402102-2910-425c-94f0-c1c9fea87f70-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.921489 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.921464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:55.927554 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:55.927528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tff6v\" (UniqueName: \"kubernetes.io/projected/79402102-2910-425c-94f0-c1c9fea87f70-kube-api-access-tff6v\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:56.423477 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:56.423441    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:56.426359 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:56.426333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79402102-2910-425c-94f0-c1c9fea87f70-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lq5kb\" (UID: \"79402102-2910-425c-94f0-c1c9fea87f70\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:56.645316 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:56.645278    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"
May 25 11:18:57.933027 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:57.932984    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:57.933471 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:57.933073    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:57.939289 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:57.939264    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:18:58.490071 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:18:58.490043    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:19:02.893732 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:02.893683    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb"]
May 25 11:19:02.896356 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:02.896326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79402102_2910_425c_94f0_c1c9fea87f70.slice/crio-04748c3d4837c5db2e15e7c2547e2b4813fd8a88e9d7583be1107721a5fdec57 WatchSource:0}: Error finding container 04748c3d4837c5db2e15e7c2547e2b4813fd8a88e9d7583be1107721a5fdec57: Status 404 returned error can't find the container with id 04748c3d4837c5db2e15e7c2547e2b4813fd8a88e9d7583be1107721a5fdec57
May 25 11:19:03.500648 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:03.500609    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb" event={"ID":"79402102-2910-425c-94f0-c1c9fea87f70","Type":"ContainerStarted","Data":"04748c3d4837c5db2e15e7c2547e2b4813fd8a88e9d7583be1107721a5fdec57"}
May 25 11:19:03.502515 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:03.502475    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-2kdlf" event={"ID":"54402251-5654-43de-a856-2235e74c9d00","Type":"ContainerStarted","Data":"00fb8e3ccad1067ae6c13f313ea7dd324d3c1295f643ffff283d80af124e1e4f"}
May 25 11:19:03.502738 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:03.502694    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:19:03.516661 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:03.516636    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-2kdlf"
May 25 11:19:03.554060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:03.554005    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-2kdlf" podStartSLOduration=1.392373597 podStartE2EDuration="18.553986857s" podCreationTimestamp="2026-05-25 11:18:45 +0000 UTC" firstStartedPulling="2026-05-25 11:18:45.681176042 +0000 UTC m=+65.143231516" lastFinishedPulling="2026-05-25 11:19:02.842789288 +0000 UTC m=+82.304844776" observedRunningTime="2026-05-25 11:19:03.525659616 +0000 UTC m=+82.987715112" watchObservedRunningTime="2026-05-25 11:19:03.553986857 +0000 UTC m=+83.016042354"
May 25 11:19:05.510817 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:05.510781    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb" event={"ID":"79402102-2910-425c-94f0-c1c9fea87f70","Type":"ContainerStarted","Data":"0a5e98f4bbb69e1fafe3a72049bc810cd24dac6f103c806218cd7c900c5b63a0"}
May 25 11:19:05.511294 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:05.510825    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb" event={"ID":"79402102-2910-425c-94f0-c1c9fea87f70","Type":"ContainerStarted","Data":"3815f216bb39f4365917b4779a33f786ceb25352e1f1ae1b0a5776db26ac4110"}
May 25 11:19:05.527619 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:05.527548    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lq5kb" podStartSLOduration=8.976197924000001 podStartE2EDuration="10.52753175s" podCreationTimestamp="2026-05-25 11:18:55 +0000 UTC" firstStartedPulling="2026-05-25 11:19:02.898271116 +0000 UTC m=+82.360326592" lastFinishedPulling="2026-05-25 11:19:04.449604925 +0000 UTC m=+83.911660418" observedRunningTime="2026-05-25 11:19:05.526796125 +0000 UTC m=+84.988851622" watchObservedRunningTime="2026-05-25 11:19:05.52753175 +0000 UTC m=+84.989587264"
May 25 11:19:06.382996 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:06.382962    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:19:07.179620 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.179588    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"]
May 25 11:19:07.209157 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.209128    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g4pmb"]
May 25 11:19:07.209336 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.209313    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.212123 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.212100    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 25 11:19:07.212225 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.212101    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 25 11:19:07.212925 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.212905    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 25 11:19:07.213025 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.212913    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7d2v2\""
May 25 11:19:07.231595 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.231574    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"]
May 25 11:19:07.231702 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.231682    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.234168 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.234146    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 11:19:07.234168 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.234165    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qlxnt\""
May 25 11:19:07.234331 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.234165    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 11:19:07.234422 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.234399    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 11:19:07.309114 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.309251 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.309251 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.309251 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2wcz\" (UniqueName: \"kubernetes.io/projected/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-api-access-t2wcz\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.309251 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.309427 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.309278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b15ebf5-b939-410e-9457-c899d1ce18eb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.410529 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410495    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b15ebf5-b939-410e-9457-c899d1ce18eb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.410529 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-metrics-client-ca\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-root\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-sys\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbsrk\" (UniqueName: \"kubernetes.io/projected/d82352ba-2278-4f18-a535-53fe9c2a8fdd-kube-api-access-vbsrk\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.410781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-wtmp\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-textfile\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410832    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410894    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410930    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b15ebf5-b939-410e-9457-c899d1ce18eb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410934    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:19:07.410934    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.410971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-tls\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.411000    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2wcz\" (UniqueName: \"kubernetes.io/projected/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-api-access-t2wcz\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:19:07.411022    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls podName:5b15ebf5-b939-410e-9457-c899d1ce18eb nodeName:}" failed. No retries permitted until 2026-05-25 11:19:07.910998792 +0000 UTC m=+87.373054269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-4s4tf" (UID: "5b15ebf5-b939-410e-9457-c899d1ce18eb") : secret "kube-state-metrics-tls" not found
May 25 11:19:07.411092 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.411064    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411625 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.411552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.411918 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.411888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.414231 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.414207    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.420731 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.420687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2wcz\" (UniqueName: \"kubernetes.io/projected/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-api-access-t2wcz\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.512476 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512404    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-tls\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512476 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512452    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-metrics-client-ca\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512497    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-root\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512525    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512582    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-sys\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512609    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbsrk\" (UniqueName: \"kubernetes.io/projected/d82352ba-2278-4f18-a535-53fe9c2a8fdd-kube-api-access-vbsrk\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-root\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512668    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-wtmp\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.512698 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512699    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-textfile\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.513091 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512701    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-sys\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.513091 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.512869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-wtmp\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.513260 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.513238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-textfile\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.513416 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.513392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.513501 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.513423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d82352ba-2278-4f18-a535-53fe9c2a8fdd-metrics-client-ca\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.515212 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.515188    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.515317 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.515293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d82352ba-2278-4f18-a535-53fe9c2a8fdd-node-exporter-tls\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.522253 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.522230    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbsrk\" (UniqueName: \"kubernetes.io/projected/d82352ba-2278-4f18-a535-53fe9c2a8fdd-kube-api-access-vbsrk\") pod \"node-exporter-g4pmb\" (UID: \"d82352ba-2278-4f18-a535-53fe9c2a8fdd\") " pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.541278 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.541255    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4pmb"
May 25 11:19:07.550497 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:07.550473    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82352ba_2278_4f18_a535_53fe9c2a8fdd.slice/crio-7e9e53799f42c1adcf1104c4007563c497421432c2e618b0bfad7cef35384717 WatchSource:0}: Error finding container 7e9e53799f42c1adcf1104c4007563c497421432c2e618b0bfad7cef35384717: Status 404 returned error can't find the container with id 7e9e53799f42c1adcf1104c4007563c497421432c2e618b0bfad7cef35384717
May 25 11:19:07.918097 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.918062    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:07.920968 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:07.920934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b15ebf5-b939-410e-9457-c899d1ce18eb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4s4tf\" (UID: \"5b15ebf5-b939-410e-9457-c899d1ce18eb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:08.120013 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.119937    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"
May 25 11:19:08.158636 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.158543    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:19:08.196074 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.196016    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.197013 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.196985    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:19:08.199951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.199900    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 11:19:08.200188 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.200168    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 11:19:08.200398 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.200379    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 11:19:08.201035 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201015    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 11:19:08.201133 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201037    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kg76p\""
May 25 11:19:08.201638 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201270    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 11:19:08.201638 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201434    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 11:19:08.201803 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201768    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 11:19:08.201997 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.201982    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 11:19:08.202825 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.202652    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 11:19:08.307207 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.306931    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf"]
May 25 11:19:08.310647 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:08.310614    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b15ebf5_b939_410e_9457_c899d1ce18eb.slice/crio-068f6452f6b96dab1782cdfb3247a8626fe05aacc9bb1ab3590ce42415bd75e0 WatchSource:0}: Error finding container 068f6452f6b96dab1782cdfb3247a8626fe05aacc9bb1ab3590ce42415bd75e0: Status 404 returned error can't find the container with id 068f6452f6b96dab1782cdfb3247a8626fe05aacc9bb1ab3590ce42415bd75e0
May 25 11:19:08.321046 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321157 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321157 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321157 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321316 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321369 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321369 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321472 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zjc2\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-kube-api-access-5zjc2\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321472 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-out\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321472 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321635 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321635 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.321635 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.321530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-web-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422077 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422041    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422091    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422123    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zjc2\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-kube-api-access-5zjc2\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422154    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-out\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422184    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422213    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422243    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422266    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-web-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422298    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422347    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422378    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.422545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.422405    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.423549 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.423521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.424413 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.424385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.424688 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.424662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.427951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.427608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.427951 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.427915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.428228 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.428179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-out\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.429169 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.429144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.429483 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.429418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-web-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.430280 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.430252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.431041 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.430994    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.431041 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.431009    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.431909 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.431867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.432477 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.432454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zjc2\" (UniqueName: \"kubernetes.io/projected/0cf54aaa-ef0b-42c4-94b0-120fcd15badb-kube-api-access-5zjc2\") pod \"alertmanager-main-0\" (UID: \"0cf54aaa-ef0b-42c4-94b0-120fcd15badb\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.517143 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.517064    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:19:08.520863 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.520830    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf" event={"ID":"5b15ebf5-b939-410e-9457-c899d1ce18eb","Type":"ContainerStarted","Data":"068f6452f6b96dab1782cdfb3247a8626fe05aacc9bb1ab3590ce42415bd75e0"}
May 25 11:19:08.522183 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.522148    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4pmb" event={"ID":"d82352ba-2278-4f18-a535-53fe9c2a8fdd","Type":"ContainerStarted","Data":"7e9e53799f42c1adcf1104c4007563c497421432c2e618b0bfad7cef35384717"}
May 25 11:19:08.952122 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:08.952085    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:19:08.955970 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:08.955941    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf54aaa_ef0b_42c4_94b0_120fcd15badb.slice/crio-e5bd66514257e0ae029f96a0dd343c899ab57256a5fff021f4936c41a5f9208f WatchSource:0}: Error finding container e5bd66514257e0ae029f96a0dd343c899ab57256a5fff021f4936c41a5f9208f: Status 404 returned error can't find the container with id e5bd66514257e0ae029f96a0dd343c899ab57256a5fff021f4936c41a5f9208f
May 25 11:19:09.529186 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:09.528403    2562 generic.go:358] "Generic (PLEG): container finished" podID="d82352ba-2278-4f18-a535-53fe9c2a8fdd" containerID="7bda334b3ca7796d779cb722686b3e4211a399463bddbab248696d4501783ffd" exitCode=0
May 25 11:19:09.529186 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:09.528481    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4pmb" event={"ID":"d82352ba-2278-4f18-a535-53fe9c2a8fdd","Type":"ContainerDied","Data":"7bda334b3ca7796d779cb722686b3e4211a399463bddbab248696d4501783ffd"}
May 25 11:19:09.531134 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:09.531076    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"e5bd66514257e0ae029f96a0dd343c899ab57256a5fff021f4936c41a5f9208f"}
May 25 11:19:10.080211 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.080144    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"]
May 25 11:19:10.097795 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.097762    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.099548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.099520    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"]
May 25 11:19:10.102173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.101695    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6lf2z\""
May 25 11:19:10.102173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.101760    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 25 11:19:10.102173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.101785    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7ko9ftbdg15nr\""
May 25 11:19:10.102173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.102022    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 25 11:19:10.102792 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.102621    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 25 11:19:10.105312 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.105125    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 25 11:19:10.105414 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.105401    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 25 11:19:10.244765 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f016a4e-eff3-4316-ad0c-2a575d432210-metrics-client-ca\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.244985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-grpc-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.245180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.245135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gn5l\" (UniqueName: \"kubernetes.io/projected/5f016a4e-eff3-4316-ad0c-2a575d432210-kube-api-access-6gn5l\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.345922 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.345803    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.345922 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.345869    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.345922 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.345895    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f016a4e-eff3-4316-ad0c-2a575d432210-metrics-client-ca\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.345929    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.345963    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.346007    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.346036    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-grpc-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.346064    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gn5l\" (UniqueName: \"kubernetes.io/projected/5f016a4e-eff3-4316-ad0c-2a575d432210-kube-api-access-6gn5l\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.347428 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.347323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f016a4e-eff3-4316-ad0c-2a575d432210-metrics-client-ca\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.352200 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.351897    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.352200 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.352168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.352337 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.352280    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-grpc-tls\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.352942 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.352899    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.353349 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.353321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.355199 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.355153    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f016a4e-eff3-4316-ad0c-2a575d432210-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.355291 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.355259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gn5l\" (UniqueName: \"kubernetes.io/projected/5f016a4e-eff3-4316-ad0c-2a575d432210-kube-api-access-6gn5l\") pod \"thanos-querier-66cdcdcf7b-xxwxc\" (UID: \"5f016a4e-eff3-4316-ad0c-2a575d432210\") " pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.410584 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.410538    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:10.536906 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.536864    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4pmb" event={"ID":"d82352ba-2278-4f18-a535-53fe9c2a8fdd","Type":"ContainerStarted","Data":"61f0ff306113999f46b5e3e488d69c15885269daf1e68015ccc341e910446f26"}
May 25 11:19:10.536906 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.536910    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4pmb" event={"ID":"d82352ba-2278-4f18-a535-53fe9c2a8fdd","Type":"ContainerStarted","Data":"86f28ea6f82b5eaa52a66e95782526de2ec10a1be5d819bd9ecb519f1b8d3ce8"}
May 25 11:19:10.559617 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:10.559554    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g4pmb" podStartSLOduration=1.952471159 podStartE2EDuration="3.559537021s" podCreationTimestamp="2026-05-25 11:19:07 +0000 UTC" firstStartedPulling="2026-05-25 11:19:07.552471023 +0000 UTC m=+87.014526513" lastFinishedPulling="2026-05-25 11:19:09.159536887 +0000 UTC m=+88.621592375" observedRunningTime="2026-05-25 11:19:10.558499632 +0000 UTC m=+90.020555130" watchObservedRunningTime="2026-05-25 11:19:10.559537021 +0000 UTC m=+90.021592517"
May 25 11:19:11.079045 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.078869    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"]
May 25 11:19:11.087313 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:11.087285    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f016a4e_eff3_4316_ad0c_2a575d432210.slice/crio-2cf434bf0f4a0b24cb8eb6cba1e1312072f9503203200c69379173d5460f4f83 WatchSource:0}: Error finding container 2cf434bf0f4a0b24cb8eb6cba1e1312072f9503203200c69379173d5460f4f83: Status 404 returned error can't find the container with id 2cf434bf0f4a0b24cb8eb6cba1e1312072f9503203200c69379173d5460f4f83
May 25 11:19:11.495715 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.495629    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78c8c9678f-7kj7g"]
May 25 11:19:11.527411 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.527378    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c8c9678f-7kj7g"]
May 25 11:19:11.529122 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.527559    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530337    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530335    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530653    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6pc8c\""
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530669    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9v1mqiom5o7ga\""
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530719    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 25 11:19:11.531250 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.530668    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 11:19:11.546421 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.545911    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf" event={"ID":"5b15ebf5-b939-410e-9457-c899d1ce18eb","Type":"ContainerStarted","Data":"06273a5d635f0a0ca68b4eebfb523f1c30a2feb119578c085b04b90061ab46bb"}
May 25 11:19:11.546421 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.545947    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf" event={"ID":"5b15ebf5-b939-410e-9457-c899d1ce18eb","Type":"ContainerStarted","Data":"1451260cf0f61965367afd6e81eee68a1976dae7a8355e11e753af4e7bf5c258"}
May 25 11:19:11.546421 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.545969    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf" event={"ID":"5b15ebf5-b939-410e-9457-c899d1ce18eb","Type":"ContainerStarted","Data":"8220b877a51d4688b96841ba6b71d992aa15cae2c67516f017cc9fb785d49f3f"}
May 25 11:19:11.547985 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.547937    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"2cf434bf0f4a0b24cb8eb6cba1e1312072f9503203200c69379173d5460f4f83"}
May 25 11:19:11.549875 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.549835    2562 generic.go:358] "Generic (PLEG): container finished" podID="0cf54aaa-ef0b-42c4-94b0-120fcd15badb" containerID="1c89f3e3899979a28653c571342ae757f2ee5e3f260e035232ede5d198d5f2f2" exitCode=0
May 25 11:19:11.550150 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.549916    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerDied","Data":"1c89f3e3899979a28653c571342ae757f2ee5e3f260e035232ede5d198d5f2f2"}
May 25 11:19:11.566761 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.566713    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4s4tf" podStartSLOduration=1.955828415 podStartE2EDuration="4.566697402s" podCreationTimestamp="2026-05-25 11:19:07 +0000 UTC" firstStartedPulling="2026-05-25 11:19:08.31266412 +0000 UTC m=+87.774719597" lastFinishedPulling="2026-05-25 11:19:10.923533097 +0000 UTC m=+90.385588584" observedRunningTime="2026-05-25 11:19:11.566118254 +0000 UTC m=+91.028173751" watchObservedRunningTime="2026-05-25 11:19:11.566697402 +0000 UTC m=+91.028752900"
May 25 11:19:11.663504 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.663470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.663687 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.663584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttjd\" (UniqueName: \"kubernetes.io/projected/20f32b64-089c-42ce-96e4-366735bcd054-kube-api-access-5ttjd\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.663687 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.663675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-metrics-server-audit-profiles\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.664130 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.664042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-client-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.664130 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.664082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-client-certs\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.664311 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.664166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20f32b64-089c-42ce-96e4-366735bcd054-audit-log\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.664311 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.664298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-tls\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765345 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765269    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-tls\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765345 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765319    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765356    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttjd\" (UniqueName: \"kubernetes.io/projected/20f32b64-089c-42ce-96e4-366735bcd054-kube-api-access-5ttjd\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765395    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-metrics-server-audit-profiles\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765438    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-client-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765475    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-client-certs\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.765541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765513    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20f32b64-089c-42ce-96e4-366735bcd054-audit-log\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.766272 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.765872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20f32b64-089c-42ce-96e4-366735bcd054-audit-log\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.766272 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.766131    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.766515 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.766488    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20f32b64-089c-42ce-96e4-366735bcd054-metrics-server-audit-profiles\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.768448 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.768417    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-tls\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.768666 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.768632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-client-ca-bundle\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.768848 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.768829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20f32b64-089c-42ce-96e4-366735bcd054-secret-metrics-server-client-certs\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.785781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.785737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttjd\" (UniqueName: \"kubernetes.io/projected/20f32b64-089c-42ce-96e4-366735bcd054-kube-api-access-5ttjd\") pod \"metrics-server-78c8c9678f-7kj7g\" (UID: \"20f32b64-089c-42ce-96e4-366735bcd054\") " pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.843464 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.843436    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:11.883893 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.883860    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"]
May 25 11:19:11.905213 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.902948    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"]
May 25 11:19:11.905213 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.903107    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:11.906765 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.906739    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 25 11:19:11.907062 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.907046    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-74zl7\""
May 25 11:19:11.992736 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:11.992703    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c8c9678f-7kj7g"]
May 25 11:19:11.995229 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:11.995202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f32b64_089c_42ce_96e4_366735bcd054.slice/crio-70b772a8b32781c32c2ec8382c78388fddb558b99329a75069f6237562e40586 WatchSource:0}: Error finding container 70b772a8b32781c32c2ec8382c78388fddb558b99329a75069f6237562e40586: Status 404 returned error can't find the container with id 70b772a8b32781c32c2ec8382c78388fddb558b99329a75069f6237562e40586
May 25 11:19:12.068762 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.068730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8qtxz\" (UID: \"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:12.169154 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.169120    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8qtxz\" (UID: \"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:12.169319 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:19:12.169274    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 25 11:19:12.169388 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:19:12.169344    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert podName:d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0 nodeName:}" failed. No retries permitted until 2026-05-25 11:19:12.669324255 +0000 UTC m=+92.131379729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-8qtxz" (UID: "d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0") : secret "monitoring-plugin-cert" not found
May 25 11:19:12.556029 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.555993    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g" event={"ID":"20f32b64-089c-42ce-96e4-366735bcd054","Type":"ContainerStarted","Data":"70b772a8b32781c32c2ec8382c78388fddb558b99329a75069f6237562e40586"}
May 25 11:19:12.672236 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.672195    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8qtxz\" (UID: \"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:12.677127 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.677072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8qtxz\" (UID: \"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:12.817522 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:12.817425    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:13.456997 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.456094    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:19:13.485270 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.485241    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:19:13.485437 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.485400    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489073    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489136    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489344    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489458    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489549    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489347    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489703    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489723    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489824    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.489978    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-22xqq\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.490073    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 25 11:19:13.490524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.490232    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aoi5kj54o2oal\""
May 25 11:19:13.492504 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.492484    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 25 11:19:13.494282 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.494258    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 25 11:19:13.579380 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579380 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jv6s\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-kube-api-access-6jv6s\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.579766 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.580141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.580141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.580141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.579852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680745 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680713    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680887 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680752    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680887 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680779    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680887 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680804    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680887 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680824    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.680887 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.680859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jv6s\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-kube-api-access-6jv6s\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681103 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681072    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681168 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681141    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681230 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681204    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681279 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681247    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681322 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681291    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681375 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681323    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681375 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681348    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681483 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681378    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681483 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681401    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681483 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681436    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681483 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.681704 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.681522    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.683597 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.682629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.683597 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.682943    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684084 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.683774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684084 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.683907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684084 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.683924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684084 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.683964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684692 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.684593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684692 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.684599    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.684847 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.684786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.685135 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.684998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.686513 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.686486    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.686641 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.686513    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.688296 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.687880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d204cfc9-2d2f-47c6-b55a-1f27950581bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.688296 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.688261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.688732 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.688698    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d204cfc9-2d2f-47c6-b55a-1f27950581bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.688897 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.688878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.689105 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.689084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d204cfc9-2d2f-47c6-b55a-1f27950581bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.690657 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.690638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jv6s\" (UniqueName: \"kubernetes.io/projected/d204cfc9-2d2f-47c6-b55a-1f27950581bc-kube-api-access-6jv6s\") pod \"prometheus-k8s-0\" (UID: \"d204cfc9-2d2f-47c6-b55a-1f27950581bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:13.798944 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:13.798908    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:14.487598 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.487548    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"]
May 25 11:19:14.495912 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:14.495527    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d0e922_bf1e_4fa1_8b0e_15fffa2f43d0.slice/crio-081e42b5071b478275f3bfbabe745a589ea4c0b4a475e4346f422f5f6210c617 WatchSource:0}: Error finding container 081e42b5071b478275f3bfbabe745a589ea4c0b4a475e4346f422f5f6210c617: Status 404 returned error can't find the container with id 081e42b5071b478275f3bfbabe745a589ea4c0b4a475e4346f422f5f6210c617
May 25 11:19:14.528949 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.528922    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 11:19:14.532118 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:19:14.532087    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd204cfc9_2d2f_47c6_b55a_1f27950581bc.slice/crio-47e8602d8a7646822a5f0814cac16aa2df8fac29dc0c1cd8dd31de0a243e6159 WatchSource:0}: Error finding container 47e8602d8a7646822a5f0814cac16aa2df8fac29dc0c1cd8dd31de0a243e6159: Status 404 returned error can't find the container with id 47e8602d8a7646822a5f0814cac16aa2df8fac29dc0c1cd8dd31de0a243e6159
May 25 11:19:14.562619 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.562555    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"4c0b462c2d0d71477233670033d44b612eb2ed022094956cc890172ce2889cd4"}
May 25 11:19:14.563406 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.563376    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"47e8602d8a7646822a5f0814cac16aa2df8fac29dc0c1cd8dd31de0a243e6159"}
May 25 11:19:14.564413 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.564388    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz" event={"ID":"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0","Type":"ContainerStarted","Data":"081e42b5071b478275f3bfbabe745a589ea4c0b4a475e4346f422f5f6210c617"}
May 25 11:19:14.565821 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:14.565799    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"9c73a004c9ba2c34d22092c4e329a7426bba6dc01132cbb5ed81540be5fdd3f6"}
May 25 11:19:15.573377 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.573338    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"9403eac608f245e5cf28725407958ff1bcb62414ee9c94d53631892cbb1b47b8"}
May 25 11:19:15.573377 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.573383    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"881f4f540be9c823f50e1ae28993b76cc86aa1ba423618230f12fe708bf7abe3"}
May 25 11:19:15.574064 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.573398    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"8f4ad61b19df0e0ff6ee139ed7a13ca5fa5089eeb423338cc996aa0929b6a42a"}
May 25 11:19:15.574064 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.573411    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"2c2adcf468aca60b438c51ef18481bb714acb9e8a57751c59b45c80db50ee307"}
May 25 11:19:15.574985 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.574950    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g" event={"ID":"20f32b64-089c-42ce-96e4-366735bcd054","Type":"ContainerStarted","Data":"1b426eb08c120ae8ee487502c909262490081ba24711b57f4962bd0e72682a95"}
May 25 11:19:15.577306 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.577279    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"08057f5c7b6388f9167bbfe27326714ec55ba173840fae674f0ade9006c83406"}
May 25 11:19:15.577438 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.577316    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"856db558a9704179e2a9c0839a10175eac8c0c94fc53f96f54daa560b163983e"}
May 25 11:19:15.579027 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.578965    2562 generic.go:358] "Generic (PLEG): container finished" podID="d204cfc9-2d2f-47c6-b55a-1f27950581bc" containerID="e30d25a99084aa52d24696de3c3c169b763e7ced205f009c0a509c44ddc32b5e" exitCode=0
May 25 11:19:15.579027 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.578997    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerDied","Data":"e30d25a99084aa52d24696de3c3c169b763e7ced205f009c0a509c44ddc32b5e"}
May 25 11:19:15.595929 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:15.595883    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g" podStartSLOduration=1.8887476539999999 podStartE2EDuration="4.595866797s" podCreationTimestamp="2026-05-25 11:19:11 +0000 UTC" firstStartedPulling="2026-05-25 11:19:11.997654626 +0000 UTC m=+91.459710103" lastFinishedPulling="2026-05-25 11:19:14.704773759 +0000 UTC m=+94.166829246" observedRunningTime="2026-05-25 11:19:15.594666263 +0000 UTC m=+95.056721766" watchObservedRunningTime="2026-05-25 11:19:15.595866797 +0000 UTC m=+95.057922298"
May 25 11:19:16.584833 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:16.584784    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"134508e3e95cec0875125666909e0ee2c4c71740af192ddbfdc37e586d109ca0"}
May 25 11:19:16.585862 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:16.585842    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz" event={"ID":"d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0","Type":"ContainerStarted","Data":"645c86d66f882c94c592f49bb4a5f352ed9057554c32b4061fb80198cf5a502f"}
May 25 11:19:16.590282 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:16.590265    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:16.595803 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:16.595784    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz"
May 25 11:19:16.607639 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:16.607605    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8qtxz" podStartSLOduration=3.650491525 podStartE2EDuration="5.607593802s" podCreationTimestamp="2026-05-25 11:19:11 +0000 UTC" firstStartedPulling="2026-05-25 11:19:14.498251615 +0000 UTC m=+93.960307090" lastFinishedPulling="2026-05-25 11:19:16.455353889 +0000 UTC m=+95.917409367" observedRunningTime="2026-05-25 11:19:16.605148971 +0000 UTC m=+96.067204467" watchObservedRunningTime="2026-05-25 11:19:16.607593802 +0000 UTC m=+96.069649294"
May 25 11:19:17.592877 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.592829    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"d4a52c93ea8a60777b6ffd0483e77d718cf6e9f76e37a5f11932073f4f4d9a29"}
May 25 11:19:17.593408 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.592885    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" event={"ID":"5f016a4e-eff3-4316-ad0c-2a575d432210","Type":"ContainerStarted","Data":"38216d184a2c8260d3587d00ecc8f4c7d92c1bb656f23ce847eb12d54651114c"}
May 25 11:19:17.593408 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.592961    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:17.596123 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.596095    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cf54aaa-ef0b-42c4-94b0-120fcd15badb","Type":"ContainerStarted","Data":"2b1e8e271c9c6aedd6e8cc6a9d9615492b70067eb63e791b75fd4eff9d773890"}
May 25 11:19:17.618671 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.618619    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc" podStartSLOduration=2.316406989 podStartE2EDuration="7.618603696s" podCreationTimestamp="2026-05-25 11:19:10 +0000 UTC" firstStartedPulling="2026-05-25 11:19:11.089329099 +0000 UTC m=+90.551384575" lastFinishedPulling="2026-05-25 11:19:16.391525805 +0000 UTC m=+95.853581282" observedRunningTime="2026-05-25 11:19:17.616115071 +0000 UTC m=+97.078170602" watchObservedRunningTime="2026-05-25 11:19:17.618603696 +0000 UTC m=+97.080659193"
May 25 11:19:17.644030 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:17.643919    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.141936351 podStartE2EDuration="9.643906024s" podCreationTimestamp="2026-05-25 11:19:08 +0000 UTC" firstStartedPulling="2026-05-25 11:19:08.958106887 +0000 UTC m=+88.420162360" lastFinishedPulling="2026-05-25 11:19:16.460076556 +0000 UTC m=+95.922132033" observedRunningTime="2026-05-25 11:19:17.642333235 +0000 UTC m=+97.104388734" watchObservedRunningTime="2026-05-25 11:19:17.643906024 +0000 UTC m=+97.105961552"
May 25 11:19:19.605908 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:19.605878    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"49024c4bb43b2bbdb82ba4ed212d2d22ef45c9c282d0484dfaba98e235124814"}
May 25 11:19:19.606288 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:19.605919    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"4224828a8cae320b8ec8cde8f7c818e4e83f3eb406e4d1bc5d3999514177a1fd"}
May 25 11:19:20.611633 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:20.611600    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"d3836c2bc962c6a621093aab5308fa875fcf072074e8b5d874235dfe353553b7"}
May 25 11:19:20.611633 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:20.611634    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"8601e41ab57d74e53c4138d986568d134255b1d34b749929bb6600afa3f0aabe"}
May 25 11:19:20.612020 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:20.611645    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"aa28b4a72eea7a1fc22503c0d96e6d1381d9a19a65fa8e9c8f60dd26f010adb6"}
May 25 11:19:20.612020 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:20.611653    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d204cfc9-2d2f-47c6-b55a-1f27950581bc","Type":"ContainerStarted","Data":"48183987d5e44828a549fab0515b4678ac53686df0c1fbb3103a317c20d7647d"}
May 25 11:19:20.642047 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:20.641996    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.893344575 podStartE2EDuration="7.641981682s" podCreationTimestamp="2026-05-25 11:19:13 +0000 UTC" firstStartedPulling="2026-05-25 11:19:15.580362959 +0000 UTC m=+95.042418432" lastFinishedPulling="2026-05-25 11:19:19.329000062 +0000 UTC m=+98.791055539" observedRunningTime="2026-05-25 11:19:20.639659639 +0000 UTC m=+100.101715162" watchObservedRunningTime="2026-05-25 11:19:20.641981682 +0000 UTC m=+100.104037177"
May 25 11:19:23.472159 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:23.472128    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qgcjm"
May 25 11:19:23.605097 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:23.605074    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66cdcdcf7b-xxwxc"
May 25 11:19:23.800497 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:23.800468    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:19:31.404705 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.404635    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f67b8889b-j6ghs" podUID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" containerName="console" containerID="cri-o://0ecec13530df05cc0756d240e7aa09286162f74c60d62ce4037cedcb00f602b3" gracePeriod=15
May 25 11:19:31.645018 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.644994    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f67b8889b-j6ghs_f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde/console/0.log"
May 25 11:19:31.645145 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.645031    2562 generic.go:358] "Generic (PLEG): container finished" podID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" containerID="0ecec13530df05cc0756d240e7aa09286162f74c60d62ce4037cedcb00f602b3" exitCode=2
May 25 11:19:31.645145 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.645073    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67b8889b-j6ghs" event={"ID":"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde","Type":"ContainerDied","Data":"0ecec13530df05cc0756d240e7aa09286162f74c60d62ce4037cedcb00f602b3"}
May 25 11:19:31.673141 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.673123    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f67b8889b-j6ghs_f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde/console/0.log"
May 25 11:19:31.673242 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.673189    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:19:31.732333 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732310    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732454 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732350    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfzm8\" (UniqueName: \"kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732454 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732383    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732454 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732400    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732605 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732462    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732605 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732489    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca\") pod \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\" (UID: \"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde\") "
May 25 11:19:31.732930 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732782    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config" (OuterVolumeSpecName: "console-config") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:19:31.732930 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:19:31.733067 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.732983    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca" (OuterVolumeSpecName: "service-ca") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:19:31.734650 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.734618    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:19:31.734743 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.734671    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:19:31.734743 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.734700    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8" (OuterVolumeSpecName: "kube-api-access-tfzm8") pod "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" (UID: "f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde"). InnerVolumeSpecName "kube-api-access-tfzm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:19:31.833413 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833390    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.833413 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833412    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.833548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833421    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.833548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833429    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfzm8\" (UniqueName: \"kubernetes.io/projected/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-kube-api-access-tfzm8\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.833548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833438    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.833548 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.833447    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:19:31.844311 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.844285    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:31.844369 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:31.844321    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:32.649446 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.649421    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f67b8889b-j6ghs_f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde/console/0.log"
May 25 11:19:32.649852 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.649524    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67b8889b-j6ghs" event={"ID":"f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde","Type":"ContainerDied","Data":"378841291ff4f0321aff38a5d4d393ad3993494d4fcebef6760caf151154cf3c"}
May 25 11:19:32.649852 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.649542    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67b8889b-j6ghs"
May 25 11:19:32.649852 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.649580    2562 scope.go:117] "RemoveContainer" containerID="0ecec13530df05cc0756d240e7aa09286162f74c60d62ce4037cedcb00f602b3"
May 25 11:19:32.672376 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.672352    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:19:32.674894 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:32.674874    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f67b8889b-j6ghs"]
May 25 11:19:33.157937 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:33.157909    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" path="/var/lib/kubelet/pods/f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde/volumes"
May 25 11:19:51.848717 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:51.848689    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:19:51.852765 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:19:51.852743    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78c8c9678f-7kj7g"
May 25 11:20:13.799692 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:20:13.799658    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:20:13.818512 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:20:13.818488    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:20:14.793589 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:20:14.793548    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 11:21:12.429729 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.429694    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zpf5z"]
May 25 11:21:12.430239 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.430048    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" containerName="console"
May 25 11:21:12.430239 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.430059    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" containerName="console"
May 25 11:21:12.430239 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.430135    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9796eaf-96e8-49a2-b8d4-ab0ed98a5cde" containerName="console"
May 25 11:21:12.431998 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.431977    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.436060 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.436034    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 11:21:12.445190 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.445166    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zpf5z"]
May 25 11:21:12.528894 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.528863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/083909e6-0b33-4eea-aa44-1b290db85ee8-original-pull-secret\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.529022 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.528908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-dbus\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.529022 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.528956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-kubelet-config\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.629655 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.629628    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/083909e6-0b33-4eea-aa44-1b290db85ee8-original-pull-secret\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.629783 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.629672    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-dbus\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.629783 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.629711    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-kubelet-config\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.629865 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.629786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-kubelet-config\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.629900 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.629872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/083909e6-0b33-4eea-aa44-1b290db85ee8-dbus\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.631856 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.631834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/083909e6-0b33-4eea-aa44-1b290db85ee8-original-pull-secret\") pod \"global-pull-secret-syncer-zpf5z\" (UID: \"083909e6-0b33-4eea-aa44-1b290db85ee8\") " pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.741723 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.741645    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zpf5z"
May 25 11:21:12.871402 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.871375    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zpf5z"]
May 25 11:21:12.874137 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:21:12.874111    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083909e6_0b33_4eea_aa44_1b290db85ee8.slice/crio-9b0789ec365214dfbc0c254f9ea3085bcda907bf2617bc71a7df19ff87e8dcab WatchSource:0}: Error finding container 9b0789ec365214dfbc0c254f9ea3085bcda907bf2617bc71a7df19ff87e8dcab: Status 404 returned error can't find the container with id 9b0789ec365214dfbc0c254f9ea3085bcda907bf2617bc71a7df19ff87e8dcab
May 25 11:21:12.944587 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:12.944537    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zpf5z" event={"ID":"083909e6-0b33-4eea-aa44-1b290db85ee8","Type":"ContainerStarted","Data":"9b0789ec365214dfbc0c254f9ea3085bcda907bf2617bc71a7df19ff87e8dcab"}
May 25 11:21:16.960163 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:16.960125    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zpf5z" event={"ID":"083909e6-0b33-4eea-aa44-1b290db85ee8","Type":"ContainerStarted","Data":"3eb4a29ea50a897f979210f3be5988ccccfb76abd37ef37c97a1c801736c915f"}
May 25 11:21:16.978546 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:21:16.978493    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zpf5z" podStartSLOduration=1.471681388 podStartE2EDuration="4.978480173s" podCreationTimestamp="2026-05-25 11:21:12 +0000 UTC" firstStartedPulling="2026-05-25 11:21:12.875682615 +0000 UTC m=+212.337738089" lastFinishedPulling="2026-05-25 11:21:16.382481386 +0000 UTC m=+215.844536874" observedRunningTime="2026-05-25 11:21:16.97627724 +0000 UTC m=+216.438332737" watchObservedRunningTime="2026-05-25 11:21:16.978480173 +0000 UTC m=+216.440535668"
May 25 11:22:41.076227 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:22:41.076199    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:22:41.076672 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:22:41.076482    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:22:41.080357 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:22:41.080338    2562 kubelet.go:1628] "Image garbage collection succeeded"
May 25 11:24:35.663187 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.663155    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-mq4n8"]
May 25 11:24:35.665320 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.665305    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mq4n8"
May 25 11:24:35.667842 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.667823    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-p6vk4\""
May 25 11:24:35.667931 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.667846    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 25 11:24:35.667931 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.667856    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 25 11:24:35.668625 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.668611    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 25 11:24:35.674588 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.674556    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mq4n8"]
May 25 11:24:35.797900 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.797866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wzn\" (UniqueName: \"kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn\") pod \"s3-init-mq4n8\" (UID: \"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9\") " pod="kserve/s3-init-mq4n8"
May 25 11:24:35.898723 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.898684    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wzn\" (UniqueName: \"kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn\") pod \"s3-init-mq4n8\" (UID: \"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9\") " pod="kserve/s3-init-mq4n8"
May 25 11:24:35.907312 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.907290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wzn\" (UniqueName: \"kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn\") pod \"s3-init-mq4n8\" (UID: \"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9\") " pod="kserve/s3-init-mq4n8"
May 25 11:24:35.986110 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:35.986034    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mq4n8"
May 25 11:24:36.111991 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:36.111961    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mq4n8"]
May 25 11:24:36.115486 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:24:36.115464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a6dfa8_12e9_407f_a55a_25f39dc6a7e9.slice/crio-9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496 WatchSource:0}: Error finding container 9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496: Status 404 returned error can't find the container with id 9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496
May 25 11:24:36.117101 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:36.117084    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:24:36.532499 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:36.532458    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mq4n8" event={"ID":"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9","Type":"ContainerStarted","Data":"9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496"}
May 25 11:24:40.548228 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:40.548183    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mq4n8" event={"ID":"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9","Type":"ContainerStarted","Data":"91110b794cf90b2c521639551c4ced14dbdd38eec621f975ec5632719f062015"}
May 25 11:24:40.566146 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:40.566087    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-mq4n8" podStartSLOduration=1.336173942 podStartE2EDuration="5.566068085s" podCreationTimestamp="2026-05-25 11:24:35 +0000 UTC" firstStartedPulling="2026-05-25 11:24:36.117233414 +0000 UTC m=+415.579288888" lastFinishedPulling="2026-05-25 11:24:40.347127554 +0000 UTC m=+419.809183031" observedRunningTime="2026-05-25 11:24:40.564927627 +0000 UTC m=+420.026983124" watchObservedRunningTime="2026-05-25 11:24:40.566068085 +0000 UTC m=+420.028123582"
May 25 11:24:43.558329 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:43.558298    2562 generic.go:358] "Generic (PLEG): container finished" podID="f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9" containerID="91110b794cf90b2c521639551c4ced14dbdd38eec621f975ec5632719f062015" exitCode=0
May 25 11:24:43.558713 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:43.558360    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mq4n8" event={"ID":"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9","Type":"ContainerDied","Data":"91110b794cf90b2c521639551c4ced14dbdd38eec621f975ec5632719f062015"}
May 25 11:24:44.692633 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:44.692606    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mq4n8"
May 25 11:24:44.777937 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:44.777891    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6wzn\" (UniqueName: \"kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn\") pod \"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9\" (UID: \"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9\") "
May 25 11:24:44.780079 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:44.780043    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn" (OuterVolumeSpecName: "kube-api-access-w6wzn") pod "f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9" (UID: "f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9"). InnerVolumeSpecName "kube-api-access-w6wzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:24:44.878661 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:44.878561    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6wzn\" (UniqueName: \"kubernetes.io/projected/f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9-kube-api-access-w6wzn\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:24:45.564596 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:45.564552    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mq4n8" event={"ID":"f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9","Type":"ContainerDied","Data":"9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496"}
May 25 11:24:45.564596 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:45.564599    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9706af3d547a4839828ca2f3d384d2cedb19d6b53f88a63ad9a623b18a3bf496"
May 25 11:24:45.564807 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:45.564560    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mq4n8"
May 25 11:24:56.134589 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.134492    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:24:56.135047 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.134839    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9" containerName="s3-init"
May 25 11:24:56.135047 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.134850    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9" containerName="s3-init"
May 25 11:24:56.135047 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.134910    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9" containerName="s3-init"
May 25 11:24:56.136800 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.136784    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.139088 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.139064    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
May 25 11:24:56.139206 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.139111    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:24:56.139206 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.139175    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
May 25 11:24:56.139206 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.139203    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:24:56.139893 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.139873    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-chxn5\""
May 25 11:24:56.147382 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.147361    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:24:56.274444 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.274416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.274653 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.274477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjw4\" (UniqueName: \"kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.274653 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.274613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.274761 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.274657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.375554 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.375525    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.375716 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.375596    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.375716 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.375646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njjw4\" (UniqueName: \"kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.375829 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.375714    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.375932 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.375902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.376327 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.376308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.378135 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.378112    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.384815 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.384771    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjw4\" (UniqueName: \"kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4\") pod \"isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.447800 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.447777    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:24:56.572918 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.572897    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:24:56.574808 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:24:56.574776    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161ae216_7eee_4690_af52_9f3c3ade74ba.slice/crio-7195dcdeee348cc4f5fc2fde14707e08be2c1b28fd2df82a86f159b5ee1ce60e WatchSource:0}: Error finding container 7195dcdeee348cc4f5fc2fde14707e08be2c1b28fd2df82a86f159b5ee1ce60e: Status 404 returned error can't find the container with id 7195dcdeee348cc4f5fc2fde14707e08be2c1b28fd2df82a86f159b5ee1ce60e
May 25 11:24:56.599387 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:24:56.599357    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerStarted","Data":"7195dcdeee348cc4f5fc2fde14707e08be2c1b28fd2df82a86f159b5ee1ce60e"}
May 25 11:25:00.612496 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:00.612457    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerStarted","Data":"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"}
May 25 11:25:04.624392 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:04.624359    2562 generic.go:358] "Generic (PLEG): container finished" podID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerID="162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78" exitCode=0
May 25 11:25:04.624768 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:04.624405    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerDied","Data":"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"}
May 25 11:25:17.671844 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:17.671810    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerStarted","Data":"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"}
May 25 11:25:19.681057 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:19.681019    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerStarted","Data":"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"}
May 25 11:25:19.681416 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:19.681142    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:25:19.703208 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:19.703161    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podStartSLOduration=1.447245583 podStartE2EDuration="23.703146207s" podCreationTimestamp="2026-05-25 11:24:56 +0000 UTC" firstStartedPulling="2026-05-25 11:24:56.576653691 +0000 UTC m=+436.038709167" lastFinishedPulling="2026-05-25 11:25:18.832554312 +0000 UTC m=+458.294609791" observedRunningTime="2026-05-25 11:25:19.700801196 +0000 UTC m=+459.162856692" watchObservedRunningTime="2026-05-25 11:25:19.703146207 +0000 UTC m=+459.165201704"
May 25 11:25:20.684414 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:20.684377    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:25:20.685718 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:20.685685    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:25:21.687170 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:21.687137    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:25:26.692009 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:26.691980    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:25:26.692485 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:26.692461    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:25:36.693343 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:36.693297    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:25:46.692848 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:46.692805    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:25:56.693077 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:25:56.693038    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:26:06.692794 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:06.692753    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:26:16.693228 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:16.693186    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:26:26.692807 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:26.692730    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:26:44.912707 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:44.912671    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:26:44.915960 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:44.915945    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:44.918379 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:44.918358    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
May 25 11:26:44.918496 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:44.918436    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
May 25 11:26:44.924822 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:44.924799    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:26:45.090631 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.090594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.090794 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.090681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.192196 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.192118    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.192196 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.192172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.192775 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.192754    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.194446 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.194430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls\") pod \"model-chainer-7d974fc4cf-t4hfw\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") " pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.226894 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.226869    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:45.350204 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.350070    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:26:45.352981 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:26:45.352952    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fca304_5af8_4d5a_b8b8_9e4a4d40332d.slice/crio-8610017f054397ad5812e20921ae5244e66e44c3830f97c4737221eef3e886d7 WatchSource:0}: Error finding container 8610017f054397ad5812e20921ae5244e66e44c3830f97c4737221eef3e886d7: Status 404 returned error can't find the container with id 8610017f054397ad5812e20921ae5244e66e44c3830f97c4737221eef3e886d7
May 25 11:26:45.931697 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:45.931656    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" event={"ID":"84fca304-5af8-4d5a-b8b8-9e4a4d40332d","Type":"ContainerStarted","Data":"8610017f054397ad5812e20921ae5244e66e44c3830f97c4737221eef3e886d7"}
May 25 11:26:47.945726 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:47.945689    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" event={"ID":"84fca304-5af8-4d5a-b8b8-9e4a4d40332d","Type":"ContainerStarted","Data":"c0c04d2b9fd7296787ac675e71c8b94387b4657060516508535d2f8db43bcb49"}
May 25 11:26:47.946180 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:47.945753    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:47.967117 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:47.967070    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podStartSLOduration=2.220773427 podStartE2EDuration="3.967055073s" podCreationTimestamp="2026-05-25 11:26:44 +0000 UTC" firstStartedPulling="2026-05-25 11:26:45.354746334 +0000 UTC m=+544.816801811" lastFinishedPulling="2026-05-25 11:26:47.101027979 +0000 UTC m=+546.563083457" observedRunningTime="2026-05-25 11:26:47.967034888 +0000 UTC m=+547.429090384" watchObservedRunningTime="2026-05-25 11:26:47.967055073 +0000 UTC m=+547.429110570"
May 25 11:26:53.954947 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:53.954920    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:26:55.012878 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.012845    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:26:55.013225 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.013052    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" containerID="cri-o://c0c04d2b9fd7296787ac675e71c8b94387b4657060516508535d2f8db43bcb49" gracePeriod=30
May 25 11:26:55.143722 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.143692    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:26:55.144093 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.144044    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" containerID="cri-o://0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309" gracePeriod=30
May 25 11:26:55.144182 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.144068    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kube-rbac-proxy" containerID="cri-o://0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7" gracePeriod=30
May 25 11:26:55.972331 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.972300    2562 generic.go:358] "Generic (PLEG): container finished" podID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerID="0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7" exitCode=2
May 25 11:26:55.972541 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:55.972377    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerDied","Data":"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"}
May 25 11:26:56.687405 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:56.687357    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused"
May 25 11:26:56.692722 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:56.692695    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 25 11:26:58.953781 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:58.953738    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:26:59.394702 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.394676    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:26:59.507236 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507205    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location\") pod \"161ae216-7eee-4690-af52-9f3c3ade74ba\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") "
May 25 11:26:59.507389 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507250    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"161ae216-7eee-4690-af52-9f3c3ade74ba\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") "
May 25 11:26:59.507389 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507277    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls\") pod \"161ae216-7eee-4690-af52-9f3c3ade74ba\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") "
May 25 11:26:59.507389 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507307    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njjw4\" (UniqueName: \"kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4\") pod \"161ae216-7eee-4690-af52-9f3c3ade74ba\" (UID: \"161ae216-7eee-4690-af52-9f3c3ade74ba\") "
May 25 11:26:59.507579 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507542    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "161ae216-7eee-4690-af52-9f3c3ade74ba" (UID: "161ae216-7eee-4690-af52-9f3c3ade74ba"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:26:59.507683 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507657    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config") pod "161ae216-7eee-4690-af52-9f3c3ade74ba" (UID: "161ae216-7eee-4690-af52-9f3c3ade74ba"). InnerVolumeSpecName "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:59.507728 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.507686    2562 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161ae216-7eee-4690-af52-9f3c3ade74ba-kserve-provision-location\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:26:59.509499 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.509474    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4" (OuterVolumeSpecName: "kube-api-access-njjw4") pod "161ae216-7eee-4690-af52-9f3c3ade74ba" (UID: "161ae216-7eee-4690-af52-9f3c3ade74ba"). InnerVolumeSpecName "kube-api-access-njjw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:59.509499 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.509496    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "161ae216-7eee-4690-af52-9f3c3ade74ba" (UID: "161ae216-7eee-4690-af52-9f3c3ade74ba"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:59.608864 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.608836    2562 reconciler_common.go:299] "Volume detached for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/161ae216-7eee-4690-af52-9f3c3ade74ba-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:26:59.608864 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.608860    2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/161ae216-7eee-4690-af52-9f3c3ade74ba-proxy-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:26:59.608864 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.608872    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njjw4\" (UniqueName: \"kubernetes.io/projected/161ae216-7eee-4690-af52-9f3c3ade74ba-kube-api-access-njjw4\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:26:59.992118 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.992083    2562 generic.go:358] "Generic (PLEG): container finished" podID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerID="0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309" exitCode=0
May 25 11:26:59.992545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.992125    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerDied","Data":"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"}
May 25 11:26:59.992545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.992152    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn" event={"ID":"161ae216-7eee-4690-af52-9f3c3ade74ba","Type":"ContainerDied","Data":"7195dcdeee348cc4f5fc2fde14707e08be2c1b28fd2df82a86f159b5ee1ce60e"}
May 25 11:26:59.992545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.992170    2562 scope.go:117] "RemoveContainer" containerID="0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"
May 25 11:26:59.992545 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:26:59.992175    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"
May 25 11:27:00.000362 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.000345    2562 scope.go:117] "RemoveContainer" containerID="0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"
May 25 11:27:00.007507 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.007489    2562 scope.go:117] "RemoveContainer" containerID="162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"
May 25 11:27:00.013481 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.013461    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:27:00.014436 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.014415    2562 scope.go:117] "RemoveContainer" containerID="0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"
May 25 11:27:00.014713 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:27:00.014692    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7\": container with ID starting with 0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7 not found: ID does not exist" containerID="0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"
May 25 11:27:00.014772 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.014721    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7"} err="failed to get container status \"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7\": rpc error: code = NotFound desc = could not find container \"0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7\": container with ID starting with 0481a5833c113e277037002fb25c9875f2da6a2c957cf09991ef2322ad4ca1e7 not found: ID does not exist"
May 25 11:27:00.014772 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.014751    2562 scope.go:117] "RemoveContainer" containerID="0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"
May 25 11:27:00.014993 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:27:00.014975    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309\": container with ID starting with 0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309 not found: ID does not exist" containerID="0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"
May 25 11:27:00.015052 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.014999    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309"} err="failed to get container status \"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309\": rpc error: code = NotFound desc = could not find container \"0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309\": container with ID starting with 0ad157f38a6ba04504a2627f7c9712936c9703bddf3f410e5cc5f803ef679309 not found: ID does not exist"
May 25 11:27:00.015052 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.015015    2562 scope.go:117] "RemoveContainer" containerID="162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"
May 25 11:27:00.015264 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:27:00.015246    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78\": container with ID starting with 162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78 not found: ID does not exist" containerID="162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"
May 25 11:27:00.015658 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.015269    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78"} err="failed to get container status \"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78\": rpc error: code = NotFound desc = could not find container \"162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78\": container with ID starting with 162d8cd78899a71790e2ab07442ae37c9a6049dcd6f9c55bd01afe7a2c986b78 not found: ID does not exist"
May 25 11:27:00.017135 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:00.017115    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6465d87db8-2q8dn"]
May 25 11:27:01.160083 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:01.160051    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" path="/var/lib/kubelet/pods/161ae216-7eee-4690-af52-9f3c3ade74ba/volumes"
May 25 11:27:03.953000 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:03.952963    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:27:08.953379 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:08.953329    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:27:08.953774 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:08.953453    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:27:13.953078 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:13.953041    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:27:18.953138 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:18.953099    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:27:23.953205 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:23.953163    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:27:25.072481 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.072451    2562 generic.go:358] "Generic (PLEG): container finished" podID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerID="c0c04d2b9fd7296787ac675e71c8b94387b4657060516508535d2f8db43bcb49" exitCode=0
May 25 11:27:25.072817 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.072519    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" event={"ID":"84fca304-5af8-4d5a-b8b8-9e4a4d40332d","Type":"ContainerDied","Data":"c0c04d2b9fd7296787ac675e71c8b94387b4657060516508535d2f8db43bcb49"}
May 25 11:27:25.154153 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.154132    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:27:25.230535 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.230499    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls\") pod \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") "
May 25 11:27:25.230714 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.230551    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle\") pod \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\" (UID: \"84fca304-5af8-4d5a-b8b8-9e4a4d40332d\") "
May 25 11:27:25.230995 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.230973    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "84fca304-5af8-4d5a-b8b8-9e4a4d40332d" (UID: "84fca304-5af8-4d5a-b8b8-9e4a4d40332d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:27:25.232531 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.232503    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "84fca304-5af8-4d5a-b8b8-9e4a4d40332d" (UID: "84fca304-5af8-4d5a-b8b8-9e4a4d40332d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:27:25.331871 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.331839    2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-proxy-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:27:25.331871 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:25.331868    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84fca304-5af8-4d5a-b8b8-9e4a4d40332d-openshift-service-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:27:26.079274 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:26.079236    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw" event={"ID":"84fca304-5af8-4d5a-b8b8-9e4a4d40332d","Type":"ContainerDied","Data":"8610017f054397ad5812e20921ae5244e66e44c3830f97c4737221eef3e886d7"}
May 25 11:27:26.079714 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:26.079283    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"
May 25 11:27:26.079714 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:26.079288    2562 scope.go:117] "RemoveContainer" containerID="c0c04d2b9fd7296787ac675e71c8b94387b4657060516508535d2f8db43bcb49"
May 25 11:27:26.100581 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:26.100547    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:27:26.104111 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:26.104087    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7d974fc4cf-t4hfw"]
May 25 11:27:27.157623 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:27.157595    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" path="/var/lib/kubelet/pods/84fca304-5af8-4d5a-b8b8-9e4a4d40332d/volumes"
May 25 11:27:41.098693 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:41.098667    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:27:41.101287 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:41.101262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:27:55.205988 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.205912    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206234    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kube-rbac-proxy"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206244    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kube-rbac-proxy"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206258    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206264    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206277    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206283    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206290    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="storage-initializer"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206296    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="storage-initializer"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206341    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="84fca304-5af8-4d5a-b8b8-9e4a4d40332d" containerName="model-chainer"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206352    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kube-rbac-proxy"
May 25 11:27:55.206419 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.206360    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="161ae216-7eee-4690-af52-9f3c3ade74ba" containerName="kserve-container"
May 25 11:27:55.210587 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.210554    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.212945 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.212918    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-f16f5-kube-rbac-proxy-sar-config\""
May 25 11:27:55.213064 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.212990    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-chxn5\""
May 25 11:27:55.213064 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.213000    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:27:55.213064 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.212987    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-f16f5-serving-cert\""
May 25 11:27:55.220290 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.220269    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:27:55.277456 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.277424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.277635 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.277469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.378634 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.378593    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.378803 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.378653    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.378803 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:27:55.378682    2562 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-f16f5-serving-cert: secret "sequence-graph-f16f5-serving-cert" not found
May 25 11:27:55.378803 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:27:55.378755    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls podName:21bad3a0-fb8a-4668-8a3b-75841ab8290a nodeName:}" failed. No retries permitted until 2026-05-25 11:27:55.878737535 +0000 UTC m=+615.340793013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls") pod "sequence-graph-f16f5-5b574b565f-qfm26" (UID: "21bad3a0-fb8a-4668-8a3b-75841ab8290a") : secret "sequence-graph-f16f5-serving-cert" not found
May 25 11:27:55.379271 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.379251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.883291 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.883243    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:55.885674 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:55.885641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") pod \"sequence-graph-f16f5-5b574b565f-qfm26\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") " pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:56.121046 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:56.121008    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:56.252227 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:56.251471    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:27:57.170053 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:57.170017    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" event={"ID":"21bad3a0-fb8a-4668-8a3b-75841ab8290a","Type":"ContainerStarted","Data":"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"}
May 25 11:27:57.170053 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:57.170054    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" event={"ID":"21bad3a0-fb8a-4668-8a3b-75841ab8290a","Type":"ContainerStarted","Data":"c605d0202c2d75043ed8c9b68a45ffc11f45e95092dfb8d8adc6835ad7a7e3cf"}
May 25 11:27:57.170276 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:57.170092    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:27:57.185653 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:27:57.185602    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podStartSLOduration=2.185585124 podStartE2EDuration="2.185585124s" podCreationTimestamp="2026-05-25 11:27:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:27:57.185200316 +0000 UTC m=+616.647255813" watchObservedRunningTime="2026-05-25 11:27:57.185585124 +0000 UTC m=+616.647640620"
May 25 11:28:03.178861 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:28:03.178836    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:32:41.125044 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:32:41.124921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:32:41.129560 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:32:41.129526    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:36:09.903782 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:09.903744    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:36:09.904295 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:09.904046    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" containerID="cri-o://4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2" gracePeriod=30
May 25 11:36:13.176524 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:13.176483    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:18.177332 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:18.177279    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:23.176834 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:23.176795    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:23.177410 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:23.176907    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:36:28.176981 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:28.176939    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:33.176958 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:33.176919    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:38.177028 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:38.176993    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:36:40.079449 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.079425    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:36:40.215318 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.215238    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") pod \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") "
May 25 11:36:40.215446 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.215331    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle\") pod \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\" (UID: \"21bad3a0-fb8a-4668-8a3b-75841ab8290a\") "
May 25 11:36:40.215700 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.215673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "21bad3a0-fb8a-4668-8a3b-75841ab8290a" (UID: "21bad3a0-fb8a-4668-8a3b-75841ab8290a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:36:40.217285 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.217264    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "21bad3a0-fb8a-4668-8a3b-75841ab8290a" (UID: "21bad3a0-fb8a-4668-8a3b-75841ab8290a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:36:40.316585 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.316530    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21bad3a0-fb8a-4668-8a3b-75841ab8290a-openshift-service-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:36:40.316585 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.316560    2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21bad3a0-fb8a-4668-8a3b-75841ab8290a-proxy-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:36:40.682967 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.682931    2562 generic.go:358] "Generic (PLEG): container finished" podID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerID="4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2" exitCode=0
May 25 11:36:40.683128 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.682996    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"
May 25 11:36:40.683128 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.683008    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" event={"ID":"21bad3a0-fb8a-4668-8a3b-75841ab8290a","Type":"ContainerDied","Data":"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"}
May 25 11:36:40.683128 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.683033    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26" event={"ID":"21bad3a0-fb8a-4668-8a3b-75841ab8290a","Type":"ContainerDied","Data":"c605d0202c2d75043ed8c9b68a45ffc11f45e95092dfb8d8adc6835ad7a7e3cf"}
May 25 11:36:40.683128 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.683048    2562 scope.go:117] "RemoveContainer" containerID="4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"
May 25 11:36:40.691543 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.691527    2562 scope.go:117] "RemoveContainer" containerID="4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"
May 25 11:36:40.691799 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:36:40.691783    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2\": container with ID starting with 4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2 not found: ID does not exist" containerID="4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"
May 25 11:36:40.691861 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.691808    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2"} err="failed to get container status \"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2\": rpc error: code = NotFound desc = could not find container \"4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2\": container with ID starting with 4dcc6443764b79ac542cdb71e5e49108c451cb01db723269b33a44e2685a1dc2 not found: ID does not exist"
May 25 11:36:40.704263 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.704241    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:36:40.708258 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:40.708238    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-f16f5-5b574b565f-qfm26"]
May 25 11:36:41.158049 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:36:41.158019    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" path="/var/lib/kubelet/pods/21bad3a0-fb8a-4668-8a3b-75841ab8290a/volumes"
May 25 11:37:41.149496 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:37:41.149471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:37:41.153765 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:37:41.153745    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:38:20.377596 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.377551    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:38:20.378006 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.377888    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5"
May 25 11:38:20.378006 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.377899    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5"
May 25 11:38:20.378006 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.377957    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="21bad3a0-fb8a-4668-8a3b-75841ab8290a" containerName="sequence-graph-f16f5"
May 25 11:38:20.380780 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.380763    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.385641 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.385619    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:38:20.386374 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.386354    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b59e4-serving-cert\""
May 25 11:38:20.386481 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.386405    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b59e4-kube-rbac-proxy-sar-config\""
May 25 11:38:20.386481 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.386414    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-chxn5\""
May 25 11:38:20.392783 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.392763    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:38:20.484538 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.484510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.484666 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.484548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.585223 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.585190    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.585368 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.585234    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.585956 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.585927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.587619 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.587601    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls\") pod \"sequence-graph-b59e4-5f69967656-8n86s\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") " pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.691350 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.691281    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.814521 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.814388    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:38:20.817241 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:38:20.817218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45f18f5_07f7_48cc_9003_e72ae8602b1c.slice/crio-2d9466244b8423c508bf0e0ed0a2a2855e64f95b98ca83e2012511925c1a6f1f WatchSource:0}: Error finding container 2d9466244b8423c508bf0e0ed0a2a2855e64f95b98ca83e2012511925c1a6f1f: Status 404 returned error can't find the container with id 2d9466244b8423c508bf0e0ed0a2a2855e64f95b98ca83e2012511925c1a6f1f
May 25 11:38:20.819032 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.819016    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:38:20.976934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.976855    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" event={"ID":"b45f18f5-07f7-48cc-9003-e72ae8602b1c","Type":"ContainerStarted","Data":"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"}
May 25 11:38:20.976934 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.976898    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" event={"ID":"b45f18f5-07f7-48cc-9003-e72ae8602b1c","Type":"ContainerStarted","Data":"2d9466244b8423c508bf0e0ed0a2a2855e64f95b98ca83e2012511925c1a6f1f"}
May 25 11:38:20.977098 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.976965    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:38:20.999346 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:20.999298    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podStartSLOduration=0.999288311 podStartE2EDuration="999.288311ms" podCreationTimestamp="2026-05-25 11:38:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:38:20.998347716 +0000 UTC m=+1240.460403212" watchObservedRunningTime="2026-05-25 11:38:20.999288311 +0000 UTC m=+1240.461343806"
May 25 11:38:26.985170 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:38:26.985090    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:42:41.174975 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:42:41.174949    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:42:41.179780 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:42:41.179760    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:46:34.969475 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:34.969434    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:46:34.971703 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:34.969699    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" containerID="cri-o://60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83" gracePeriod=30
May 25 11:46:36.983909 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:36.983873    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:46:41.984017 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:41.983981    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:46:46.983393 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:46.983355    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:46:46.983857 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:46.983483    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:46:51.983982 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:51.983941    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:46:56.983908 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:46:56.983865    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:47:01.983424 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:01.983390    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:47:05.113960 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.113937    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:47:05.155424 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.155401    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls\") pod \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") "
May 25 11:47:05.155536 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.155451    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle\") pod \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\" (UID: \"b45f18f5-07f7-48cc-9003-e72ae8602b1c\") "
May 25 11:47:05.155810 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.155789    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b45f18f5-07f7-48cc-9003-e72ae8602b1c" (UID: "b45f18f5-07f7-48cc-9003-e72ae8602b1c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:47:05.157543 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.157521    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b45f18f5-07f7-48cc-9003-e72ae8602b1c" (UID: "b45f18f5-07f7-48cc-9003-e72ae8602b1c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:47:05.257020 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.256948    2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b45f18f5-07f7-48cc-9003-e72ae8602b1c-proxy-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:47:05.257020 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.256973    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b45f18f5-07f7-48cc-9003-e72ae8602b1c-openshift-service-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 11:47:05.473423 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.473391    2562 generic.go:358] "Generic (PLEG): container finished" podID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerID="60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83" exitCode=0
May 25 11:47:05.473620 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.473450    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"
May 25 11:47:05.473620 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.473486    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" event={"ID":"b45f18f5-07f7-48cc-9003-e72ae8602b1c","Type":"ContainerDied","Data":"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"}
May 25 11:47:05.473620 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.473525    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s" event={"ID":"b45f18f5-07f7-48cc-9003-e72ae8602b1c","Type":"ContainerDied","Data":"2d9466244b8423c508bf0e0ed0a2a2855e64f95b98ca83e2012511925c1a6f1f"}
May 25 11:47:05.473620 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.473545    2562 scope.go:117] "RemoveContainer" containerID="60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"
May 25 11:47:05.481604 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.481559    2562 scope.go:117] "RemoveContainer" containerID="60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"
May 25 11:47:05.481859 ip-10-0-131-36 kubenswrapper[2562]: E0525 11:47:05.481841    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83\": container with ID starting with 60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83 not found: ID does not exist" containerID="60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"
May 25 11:47:05.481921 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.481867    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83"} err="failed to get container status \"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83\": rpc error: code = NotFound desc = could not find container \"60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83\": container with ID starting with 60d3cb8d0b7006db0f61aaa7bdd8c9f01cd7136d38cd76e721175e226b04cf83 not found: ID does not exist"
May 25 11:47:05.489726 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.489706    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:47:05.495628 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:05.495606    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b59e4-5f69967656-8n86s"]
May 25 11:47:07.157346 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:07.157315    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" path="/var/lib/kubelet/pods/b45f18f5-07f7-48cc-9003-e72ae8602b1c/volumes"
May 25 11:47:35.161272 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.161243    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 11:47:35.161696 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.161621    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4"
May 25 11:47:35.161696 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.161633    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4"
May 25 11:47:35.161696 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.161692    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b45f18f5-07f7-48cc-9003-e72ae8602b1c" containerName="sequence-graph-b59e4"
May 25 11:47:35.164382 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.164364    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.166561 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.166530    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-c1cab-serving-cert\""
May 25 11:47:35.166561 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.166558    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-c1cab-kube-rbac-proxy-sar-config\""
May 25 11:47:35.166844 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.166824    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-chxn5\""
May 25 11:47:35.166932 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.166835    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:47:35.171885 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.171863    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 11:47:35.278704 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.278673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.278859 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.278715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.380126 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.380092    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.380269 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.380179    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.380795 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.380775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.382358 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.382340    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls\") pod \"switch-graph-c1cab-68466fbf77-hzqld\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") " pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.475436 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.475376    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:35.597828 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.597799    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 11:47:35.600754 ip-10-0-131-36 kubenswrapper[2562]: W0525 11:47:35.600728    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0afa2d_7e9d_4c80_a42a_f69a8370c34e.slice/crio-5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed WatchSource:0}: Error finding container 5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed: Status 404 returned error can't find the container with id 5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed
May 25 11:47:35.602425 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:35.602410    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:47:36.564918 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:36.564884    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" event={"ID":"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e","Type":"ContainerStarted","Data":"0c139583c480073edce1e7fda2deb45fca3931f2ca3b9d87c119aa1c130fe3ea"}
May 25 11:47:36.564918 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:36.564921    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" event={"ID":"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e","Type":"ContainerStarted","Data":"5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed"}
May 25 11:47:36.565338 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:36.564946    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:47:36.584035 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:36.583988    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podStartSLOduration=1.583974261 podStartE2EDuration="1.583974261s" podCreationTimestamp="2026-05-25 11:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:47:36.581814986 +0000 UTC m=+1796.043870481" watchObservedRunningTime="2026-05-25 11:47:36.583974261 +0000 UTC m=+1796.046029758"
May 25 11:47:41.197777 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:41.197750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:47:41.204743 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:41.204716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:47:42.574066 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:47:42.574033    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 11:52:41.219691 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:52:41.219666    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:52:41.230845 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:52:41.230824    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:57:41.242345 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:57:41.242239    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 11:57:41.254173 ip-10-0-131-36 kubenswrapper[2562]: I0525 11:57:41.254154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 12:02:41.269379 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:02:41.269279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 12:02:41.281324 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:02:41.281303    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 12:03:54.337383 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:54.337299    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 12:03:54.337910 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:54.337525    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" containerID="cri-o://0c139583c480073edce1e7fda2deb45fca3931f2ca3b9d87c119aa1c130fe3ea" gracePeriod=30
May 25 12:03:56.086916 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.086883    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f9qkx/must-gather-zqh7f"]
May 25 12:03:56.090445 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.090429    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.092721 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.092699    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f9qkx\"/\"openshift-service-ca.crt\""
May 25 12:03:56.092844 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.092718    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f9qkx\"/\"default-dockercfg-p8lqh\""
May 25 12:03:56.092844 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.092738    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f9qkx\"/\"kube-root-ca.crt\""
May 25 12:03:56.107589 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.107548    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f9qkx/must-gather-zqh7f"]
May 25 12:03:56.218647 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.218613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.218802 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.218675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjxq\" (UniqueName: \"kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.319957 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.319920    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjxq\" (UniqueName: \"kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.320125 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.319983    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.320282 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.320268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.328662 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.328640    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjxq\" (UniqueName: \"kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq\") pod \"must-gather-zqh7f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") " pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.410646 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.410552    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:03:56.538180 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.538156    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f9qkx/must-gather-zqh7f"]
May 25 12:03:56.540681 ip-10-0-131-36 kubenswrapper[2562]: W0525 12:03:56.540646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30fe7aa2_e26d_4b9a_a606_dfc1d40dda9f.slice/crio-ef795e198467a06256bd2c250bc16c95f41fbe59bc877d57de15a194e4a8e76e WatchSource:0}: Error finding container ef795e198467a06256bd2c250bc16c95f41fbe59bc877d57de15a194e4a8e76e: Status 404 returned error can't find the container with id ef795e198467a06256bd2c250bc16c95f41fbe59bc877d57de15a194e4a8e76e
May 25 12:03:56.542388 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:56.542372    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:03:57.390314 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:57.390267    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" event={"ID":"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f","Type":"ContainerStarted","Data":"ef795e198467a06256bd2c250bc16c95f41fbe59bc877d57de15a194e4a8e76e"}
May 25 12:03:57.575545 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:03:57.575502    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:02.574184 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:02.574057    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:03.412644 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:03.412532    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" event={"ID":"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f","Type":"ContainerStarted","Data":"cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3"}
May 25 12:04:03.412644 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:03.412591    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" event={"ID":"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f","Type":"ContainerStarted","Data":"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"}
May 25 12:04:03.435365 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:03.435309    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" podStartSLOduration=1.143956752 podStartE2EDuration="7.435294535s" podCreationTimestamp="2026-05-25 12:03:56 +0000 UTC" firstStartedPulling="2026-05-25 12:03:56.542515368 +0000 UTC m=+2776.004570842" lastFinishedPulling="2026-05-25 12:04:02.833853148 +0000 UTC m=+2782.295908625" observedRunningTime="2026-05-25 12:04:03.433841846 +0000 UTC m=+2782.895897344" watchObservedRunningTime="2026-05-25 12:04:03.435294535 +0000 UTC m=+2782.897350031"
May 25 12:04:07.573252 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:07.573206    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:07.573691 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:07.573327    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 12:04:11.669280 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:11.669251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:12.463470 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:12.463444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:12.572745 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:12.572710    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:13.264141 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:13.264093    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:14.037496 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:14.037460    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:14.811881 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:14.811847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:15.604348 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:15.604316    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:16.383958 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:16.383934    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:17.188488 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:17.188455    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:17.573576 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:17.573520    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:18.043416 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:18.043389    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:18.890208 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:18.890180    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:19.716668 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:19.716637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:20.583697 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:20.583669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c1cab-68466fbf77-hzqld_9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/switch-graph-c1cab/0.log"
May 25 12:04:21.470148 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:21.470117    2562 generic.go:358] "Generic (PLEG): container finished" podID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerID="da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544" exitCode=0
May 25 12:04:21.470340 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:21.470193    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" event={"ID":"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f","Type":"ContainerDied","Data":"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"}
May 25 12:04:21.470520 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:21.470506    2562 scope.go:117] "RemoveContainer" containerID="da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"
May 25 12:04:22.261524 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:22.261498    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f9qkx_must-gather-zqh7f_30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f/gather/0.log"
May 25 12:04:22.572441 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:22.572406    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 12:04:24.483893 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.483861    2562 generic.go:358] "Generic (PLEG): container finished" podID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerID="0c139583c480073edce1e7fda2deb45fca3931f2ca3b9d87c119aa1c130fe3ea" exitCode=0
May 25 12:04:24.484228 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.483933    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" event={"ID":"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e","Type":"ContainerDied","Data":"0c139583c480073edce1e7fda2deb45fca3931f2ca3b9d87c119aa1c130fe3ea"}
May 25 12:04:24.484228 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.483978    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld" event={"ID":"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e","Type":"ContainerDied","Data":"5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed"}
May 25 12:04:24.484228 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.483994    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5961828661cb2b41318a184b5dfab56737976f73fe718e00c05290c1408609ed"
May 25 12:04:24.484347 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.484258    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 12:04:24.563153 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.563127    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls\") pod \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") "
May 25 12:04:24.563298 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.563159    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle\") pod \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\" (UID: \"9a0afa2d-7e9d-4c80-a42a-f69a8370c34e\") "
May 25 12:04:24.563527 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.563504    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" (UID: "9a0afa2d-7e9d-4c80-a42a-f69a8370c34e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 12:04:24.564977 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.564959    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" (UID: "9a0afa2d-7e9d-4c80-a42a-f69a8370c34e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:04:24.663717 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.663643    2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-proxy-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 12:04:24.663717 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:24.663668    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e-openshift-service-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 12:04:25.487722 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.487641    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"
May 25 12:04:25.500848 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.500815    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 12:04:25.503479 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.503452    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c1cab-68466fbf77-hzqld"]
May 25 12:04:25.627516 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.627486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zpf5z_083909e6-0b33-4eea-aa44-1b290db85ee8/global-pull-secret-syncer/0.log"
May 25 12:04:25.663978 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.663948    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-56c82_552f8bf2-28bd-4763-8a1b-d869d39f4126/konnectivity-agent/0.log"
May 25 12:04:25.782415 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:25.782344    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-36.ec2.internal_cd18aa3e52833def90adf242a77f563b/haproxy/0.log"
May 25 12:04:27.157554 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.157513    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" path="/var/lib/kubelet/pods/9a0afa2d-7e9d-4c80-a42a-f69a8370c34e/volumes"
May 25 12:04:27.666683 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.666644    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-f9qkx/must-gather-zqh7f"]
May 25 12:04:27.666951 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.666910    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="copy" containerID="cri-o://cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3" gracePeriod=2
May 25 12:04:27.669054 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.669022    2562 status_manager.go:895] "Failed to get status for pod" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" err="pods \"must-gather-zqh7f\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f9qkx\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object"
May 25 12:04:27.669411 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.669389    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-f9qkx/must-gather-zqh7f"]
May 25 12:04:27.891830 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.891809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f9qkx_must-gather-zqh7f_30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f/copy/0.log"
May 25 12:04:27.892139 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.892126    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:04:27.894014 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.893989    2562 status_manager.go:895] "Failed to get status for pod" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" err="pods \"must-gather-zqh7f\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f9qkx\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object"
May 25 12:04:27.992247 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.992166    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output\") pod \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") "
May 25 12:04:27.992247 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.992224    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmjxq\" (UniqueName: \"kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq\") pod \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\" (UID: \"30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f\") "
May 25 12:04:27.993714 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.993691    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" (UID: "30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:04:27.994341 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:27.994320    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq" (OuterVolumeSpecName: "kube-api-access-lmjxq") pod "30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" (UID: "30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f"). InnerVolumeSpecName "kube-api-access-lmjxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:04:28.093628 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.093591    2562 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-must-gather-output\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 12:04:28.093628 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.093621    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmjxq\" (UniqueName: \"kubernetes.io/projected/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f-kube-api-access-lmjxq\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\""
May 25 12:04:28.503248 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.503214    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f9qkx_must-gather-zqh7f_30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f/copy/0.log"
May 25 12:04:28.503703 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.503555    2562 generic.go:358] "Generic (PLEG): container finished" podID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerID="cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3" exitCode=143
May 25 12:04:28.503703 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.503626    2562 scope.go:117] "RemoveContainer" containerID="cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3"
May 25 12:04:28.503703 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.503636    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9qkx/must-gather-zqh7f"
May 25 12:04:28.505962 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.505937    2562 status_manager.go:895] "Failed to get status for pod" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" err="pods \"must-gather-zqh7f\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f9qkx\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object"
May 25 12:04:28.511986 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.511910    2562 scope.go:117] "RemoveContainer" containerID="da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"
May 25 12:04:28.514340 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.514316    2562 status_manager.go:895] "Failed to get status for pod" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" pod="openshift-must-gather-f9qkx/must-gather-zqh7f" err="pods \"must-gather-zqh7f\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f9qkx\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object"
May 25 12:04:28.524226 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.524200    2562 scope.go:117] "RemoveContainer" containerID="cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3"
May 25 12:04:28.524466 ip-10-0-131-36 kubenswrapper[2562]: E0525 12:04:28.524448    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3\": container with ID starting with cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3 not found: ID does not exist" containerID="cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3"
May 25 12:04:28.524530 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.524477    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3"} err="failed to get container status \"cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3\": rpc error: code = NotFound desc = could not find container \"cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3\": container with ID starting with cc3be7fd3940e6ef15c061a2c2f896bfab834577923f33eab4afc5bf838454e3 not found: ID does not exist"
May 25 12:04:28.524530 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.524501    2562 scope.go:117] "RemoveContainer" containerID="da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"
May 25 12:04:28.524748 ip-10-0-131-36 kubenswrapper[2562]: E0525 12:04:28.524731    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544\": container with ID starting with da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544 not found: ID does not exist" containerID="da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"
May 25 12:04:28.524805 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:28.524756    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544"} err="failed to get container status \"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544\": rpc error: code = NotFound desc = could not find container \"da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544\": container with ID starting with da4cba0a17295e267145bbd2f214ecceaf3d8b333c7bff19d904577ba282d544 not found: ID does not exist"
May 25 12:04:29.158201 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.158120    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" path="/var/lib/kubelet/pods/30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f/volumes"
May 25 12:04:29.259289 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.259261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/alertmanager/0.log"
May 25 12:04:29.285607 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.285556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/config-reloader/0.log"
May 25 12:04:29.309656 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.309637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/kube-rbac-proxy-web/0.log"
May 25 12:04:29.335461 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.335438    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/kube-rbac-proxy/0.log"
May 25 12:04:29.357081 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.357063    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/kube-rbac-proxy-metric/0.log"
May 25 12:04:29.377505 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.377483    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/prom-label-proxy/0.log"
May 25 12:04:29.398663 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.398639    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cf54aaa-ef0b-42c4-94b0-120fcd15badb/init-config-reloader/0.log"
May 25 12:04:29.461120 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.461057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4s4tf_5b15ebf5-b939-410e-9457-c899d1ce18eb/kube-state-metrics/0.log"
May 25 12:04:29.481434 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.481412    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4s4tf_5b15ebf5-b939-410e-9457-c899d1ce18eb/kube-rbac-proxy-main/0.log"
May 25 12:04:29.501297 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.501282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4s4tf_5b15ebf5-b939-410e-9457-c899d1ce18eb/kube-rbac-proxy-self/0.log"
May 25 12:04:29.528032 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.528010    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78c8c9678f-7kj7g_20f32b64-089c-42ce-96e4-366735bcd054/metrics-server/0.log"
May 25 12:04:29.554484 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.554467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-8qtxz_d3d0e922-bf1e-4fa1-8b0e-15fffa2f43d0/monitoring-plugin/0.log"
May 25 12:04:29.662443 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.662426    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4pmb_d82352ba-2278-4f18-a535-53fe9c2a8fdd/node-exporter/0.log"
May 25 12:04:29.684581 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.684545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4pmb_d82352ba-2278-4f18-a535-53fe9c2a8fdd/kube-rbac-proxy/0.log"
May 25 12:04:29.706765 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.706748    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4pmb_d82352ba-2278-4f18-a535-53fe9c2a8fdd/init-textfile/0.log"
May 25 12:04:29.894204 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.894177    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/prometheus/0.log"
May 25 12:04:29.909824 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.909800    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/config-reloader/0.log"
May 25 12:04:29.931739 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.931720    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/thanos-sidecar/0.log"
May 25 12:04:29.953674 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.953655    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/kube-rbac-proxy-web/0.log"
May 25 12:04:29.974147 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.974131    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/kube-rbac-proxy/0.log"
May 25 12:04:29.994328 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:29.994276    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/kube-rbac-proxy-thanos/0.log"
May 25 12:04:30.016877 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.016861    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d204cfc9-2d2f-47c6-b55a-1f27950581bc/init-config-reloader/0.log"
May 25 12:04:30.043201 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.043179    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lq5kb_79402102-2910-425c-94f0-c1c9fea87f70/prometheus-operator/0.log"
May 25 12:04:30.062256 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.062229    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lq5kb_79402102-2910-425c-94f0-c1c9fea87f70/kube-rbac-proxy/0.log"
May 25 12:04:30.086502 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.086485    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-kr7fg_249f7d7d-115c-43d1-980e-897af66480b3/prometheus-operator-admission-webhook/0.log"
May 25 12:04:30.210259 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.210233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/thanos-query/0.log"
May 25 12:04:30.248108 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.248045    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/kube-rbac-proxy-web/0.log"
May 25 12:04:30.279334 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.279312    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/kube-rbac-proxy/0.log"
May 25 12:04:30.306818 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.306800    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/prom-label-proxy/0.log"
May 25 12:04:30.349229 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.349207    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/kube-rbac-proxy-rules/0.log"
May 25 12:04:30.374930 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:30.374911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66cdcdcf7b-xxwxc_5f016a4e-eff3-4316-ad0c-2a575d432210/kube-rbac-proxy-metrics/0.log"
May 25 12:04:32.267263 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.267227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-2kdlf_54402251-5654-43de-a856-2235e74c9d00/download-server/0.log"
May 25 12:04:32.522316 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.522237    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"]
May 25 12:04:32.523181 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523157    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab"
May 25 12:04:32.523325 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523314    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab"
May 25 12:04:32.523426 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523417    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="gather"
May 25 12:04:32.523498 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523480    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="gather"
May 25 12:04:32.523597 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523555    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="copy"
May 25 12:04:32.523696 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523684    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="copy"
May 25 12:04:32.523823 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523810    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a0afa2d-7e9d-4c80-a42a-f69a8370c34e" containerName="switch-graph-c1cab"
May 25 12:04:32.523856 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523827    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="copy"
May 25 12:04:32.523856 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.523839    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="30fe7aa2-e26d-4b9a-a606-dfc1d40dda9f" containerName="gather"
May 25 12:04:32.529150 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.529132    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.530707 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.530685    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"]
May 25 12:04:32.531447 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.531426    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzvv7\"/\"openshift-service-ca.crt\""
May 25 12:04:32.532296 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.532270    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzvv7\"/\"kube-root-ca.crt\""
May 25 12:04:32.532395 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.532328    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fzvv7\"/\"default-dockercfg-mcf27\""
May 25 12:04:32.630247 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.630223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-sys\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.630345 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.630254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-podres\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.630345 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.630281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-lib-modules\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.630345 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.630319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsdc\" (UniqueName: \"kubernetes.io/projected/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-kube-api-access-nnsdc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.630445 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.630393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-proc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730720 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730697    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-proc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730819 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-sys\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730819 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730759    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-podres\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730819 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730798    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-lib-modules\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730819 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-proc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730951 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-sys\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.730951 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730822    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsdc\" (UniqueName: \"kubernetes.io/projected/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-kube-api-access-nnsdc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.731016 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-lib-modules\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.731016 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.730978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-podres\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.738267 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.738248    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsdc\" (UniqueName: \"kubernetes.io/projected/5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a-kube-api-access-nnsdc\") pod \"perf-node-gather-daemonset-4mq5n\" (UID: \"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a\") " pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.839069 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.839051    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:32.961975 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:32.961945    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"]
May 25 12:04:32.965749 ip-10-0-131-36 kubenswrapper[2562]: W0525 12:04:32.965719    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f6031a9_d596_45cc_aad5_ac6aa5ae0b0a.slice/crio-1e52f98f8253627f42ed9240cf054bb8fb46645b5d081a8ca74b9911335ae436 WatchSource:0}: Error finding container 1e52f98f8253627f42ed9240cf054bb8fb46645b5d081a8ca74b9911335ae436: Status 404 returned error can't find the container with id 1e52f98f8253627f42ed9240cf054bb8fb46645b5d081a8ca74b9911335ae436
May 25 12:04:33.401475 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.401443    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-897p7_0a93a2e3-dfc7-4ff1-a785-ca290b4a95de/dns/0.log"
May 25 12:04:33.424152 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.424130    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-897p7_0a93a2e3-dfc7-4ff1-a785-ca290b4a95de/kube-rbac-proxy/0.log"
May 25 12:04:33.520023 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.519990    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n" event={"ID":"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a","Type":"ContainerStarted","Data":"20c5135d7cd94151484a51958c8c0498e4d3cfce0419220ead38688b31c46471"}
May 25 12:04:33.520023 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.520021    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n" event={"ID":"5f6031a9-d596-45cc-aad5-ac6aa5ae0b0a","Type":"ContainerStarted","Data":"1e52f98f8253627f42ed9240cf054bb8fb46645b5d081a8ca74b9911335ae436"}
May 25 12:04:33.520241 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.520060    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:33.534225 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.534180    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n" podStartSLOduration=1.534167609 podStartE2EDuration="1.534167609s" podCreationTimestamp="2026-05-25 12:04:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:04:33.533715973 +0000 UTC m=+2812.995771468" watchObservedRunningTime="2026-05-25 12:04:33.534167609 +0000 UTC m=+2812.996223104"
May 25 12:04:33.539047 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:33.539024    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2vwp_71438de0-c3fa-44f6-b72d-dc3b91b80ad4/dns-node-resolver/0.log"
May 25 12:04:34.070930 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:34.070892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j6f2b_74897e03-4185-4a7e-ac3e-2be15c3ee545/node-ca/0.log"
May 25 12:04:35.241411 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:35.241385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gcr7_ddfff78b-8247-404c-9c73-4b83efa64b26/serve-healthcheck-canary/0.log"
May 25 12:04:35.794088 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:35.794055    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk4wc_6892da71-f116-43b0-8fab-7bc21a290750/kube-rbac-proxy/0.log"
May 25 12:04:35.817685 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:35.817666    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk4wc_6892da71-f116-43b0-8fab-7bc21a290750/exporter/0.log"
May 25 12:04:35.839202 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:35.839173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk4wc_6892da71-f116-43b0-8fab-7bc21a290750/extractor/0.log"
May 25 12:04:38.371944 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:38.371920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-mq4n8_f0a6dfa8-12e9-407f-a55a-25f39dc6a7e9/s3-init/0.log"
May 25 12:04:39.534407 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:39.534378    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fzvv7/perf-node-gather-daemonset-4mq5n"
May 25 12:04:41.296834 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:41.296808    2562 scope.go:117] "RemoveContainer" containerID="0c139583c480073edce1e7fda2deb45fca3931f2ca3b9d87c119aa1c130fe3ea"
May 25 12:04:42.425660 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:42.425594    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-f52ct_cd364f40-faa0-4e65-ae28-685a6fcff189/migrator/0.log"
May 25 12:04:42.445110 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:42.445087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-f52ct_cd364f40-faa0-4e65-ae28-685a6fcff189/graceful-termination/0.log"
May 25 12:04:43.903962 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:43.903932    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/kube-multus-additional-cni-plugins/0.log"
May 25 12:04:43.924468 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:43.924445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/egress-router-binary-copy/0.log"
May 25 12:04:43.944592 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:43.944554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/cni-plugins/0.log"
May 25 12:04:43.972270 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:43.972252    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/bond-cni-plugin/0.log"
May 25 12:04:43.992786 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:43.992737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/routeoverride-cni/0.log"
May 25 12:04:44.014926 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:44.014907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/whereabouts-cni-bincopy/0.log"
May 25 12:04:44.048951 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:44.048930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dft5z_4f528594-3c6a-46e9-9273-7b35c4b8660f/whereabouts-cni/0.log"
May 25 12:04:44.287633 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:44.287612    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n5xwt_158382fe-3769-4a95-aef6-8e5696df30e9/kube-multus/0.log"
May 25 12:04:44.338393 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:44.338368    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82b7t_dfe8c912-6fa2-4816-98c3-96899256f4d3/network-metrics-daemon/0.log"
May 25 12:04:44.357227 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:44.357203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82b7t_dfe8c912-6fa2-4816-98c3-96899256f4d3/kube-rbac-proxy/0.log"
May 25 12:04:45.198664 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.198625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-controller/0.log"
May 25 12:04:45.218455 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.218435    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/0.log"
May 25 12:04:45.230918 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.230902    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovn-acl-logging/1.log"
May 25 12:04:45.250988 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.250967    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/kube-rbac-proxy-node/0.log"
May 25 12:04:45.274118 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.274094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/kube-rbac-proxy-ovn-metrics/0.log"
May 25 12:04:45.295685 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.295665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/northd/0.log"
May 25 12:04:45.317129 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.317106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/nbdb/0.log"
May 25 12:04:45.339344 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.339323    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/sbdb/0.log"
May 25 12:04:45.459519 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:45.459457    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-25sdt_5755389d-04a5-45c5-b606-0e0f6b265c40/ovnkube-controller/0.log"
May 25 12:04:47.150713 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:47.150688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-9lllh_6952c1d8-2ef0-4ab5-b856-f5b56a884167/check-endpoints/0.log"
May 25 12:04:47.205700 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:47.205672    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qgcjm_f0f7d02a-5617-4d4a-b59d-b992d78b88bb/network-check-target-container/0.log"
May 25 12:04:48.256595 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:48.256500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-twfll_7200fdf4-060c-4a20-9a58-11e8a69cdcea/iptables-alerter/0.log"
May 25 12:04:48.942651 ip-10-0-131-36 kubenswrapper[2562]: I0525 12:04:48.942625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gwpht_cba8d391-17d8-4437-9932-e9489ed8f788/tuned/0.log"