May 28 19:40:54.070404 ip-10-0-138-195 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 19:40:54.070417 ip-10-0-138-195 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 19:40:54.070451 ip-10-0-138-195 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 19:40:54.070679 ip-10-0-138-195 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 19:41:04.288219 ip-10-0-138-195 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 19:41:04.288239 ip-10-0-138-195 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dc12ebebf25c4b97905ca55deb045957 --
May 28 19:43:38.278153 ip-10-0-138-195 systemd[1]: Starting Kubernetes Kubelet...
May 28 19:43:38.776067 ip-10-0-138-195 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:38.776067 ip-10-0-138-195 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 19:43:38.776067 ip-10-0-138-195 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:38.776067 ip-10-0-138-195 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 19:43:38.776067 ip-10-0-138-195 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:38.779008 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.778919    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 19:43:38.783992 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.783968    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:38.783992 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.783988    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784019    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784024    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784027    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784031    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784034    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784036    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784039    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784042    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784045    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784048    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784051    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784054    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784056    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784059    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784061    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784064    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784067    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784070    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784072    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:38.784129 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784075    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784077    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784080    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784083    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784085    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784088    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784091    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784094    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784097    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784101    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784105    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784109    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784113    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784116    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784119    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784128    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784133    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784137    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:38.784615 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784140    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784143    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784147    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784150    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784152    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784155    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784157    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784160    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784163    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784166    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784168    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784171    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784174    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784177    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784180    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784183    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784186    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784189    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784192    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784194    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:38.785105 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784197    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784199    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784202    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784205    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784209    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784212    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784215    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784217    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784220    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784223    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784226    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784228    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784231    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784233    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784236    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784239    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784241    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784244    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784246    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784250    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:38.785586 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784298    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784301    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784304    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784307    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784309    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784312    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784315    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784732    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784737    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784740    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784743    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784746    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784748    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784751    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784754    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784756    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784759    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784762    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784765    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784768    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:38.786083 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784773    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784776    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784778    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784781    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784784    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784787    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784789    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784810    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784814    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784817    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784820    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784824    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784827    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784829    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784832    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784835    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784837    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784841    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784844    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784846    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:38.786560 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784849    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784852    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784855    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784857    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784860    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784863    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784865    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784868    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784870    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784873    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784876    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784878    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784882    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784884    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784887    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784889    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784892    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784894    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784897    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784899    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:38.787085 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784902    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784905    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784908    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784910    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784913    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784917    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784921    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784924    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784927    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784930    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784932    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784935    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784938    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784940    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784943    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784945    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784948    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784950    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784953    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:38.787610 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784955    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784957    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784961    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784964    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784966    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784971    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784973    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784976    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784979    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784981    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784984    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784986    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784989    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.784991    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785069    2564 flags.go:64] FLAG: --address="0.0.0.0"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785079    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785089    2564 flags.go:64] FLAG: --anonymous-auth="true"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785096    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785102    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785106    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785111    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 19:43:38.788090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785116    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785119    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785122    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785126    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785129    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785132    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785136    2564 flags.go:64] FLAG: --cgroup-root=""
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785138    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785141    2564 flags.go:64] FLAG: --client-ca-file=""
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785145    2564 flags.go:64] FLAG: --cloud-config=""
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785147    2564 flags.go:64] FLAG: --cloud-provider="external"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785150    2564 flags.go:64] FLAG: --cluster-dns="[]"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785156    2564 flags.go:64] FLAG: --cluster-domain=""
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785159    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785162    2564 flags.go:64] FLAG: --config-dir=""
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785165    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785169    2564 flags.go:64] FLAG: --container-log-max-files="5"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785173    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785176    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785179    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785183    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785186    2564 flags.go:64] FLAG: --contention-profiling="false"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785189    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785192    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785195    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 19:43:38.788610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785198    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785202    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785205    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785208    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785211    2564 flags.go:64] FLAG: --enable-load-reader="false"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785215    2564 flags.go:64] FLAG: --enable-server="true"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785218    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785222    2564 flags.go:64] FLAG: --event-burst="100"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785225    2564 flags.go:64] FLAG: --event-qps="50"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785228    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785232    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785235    2564 flags.go:64] FLAG: --eviction-hard=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785239    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785242    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785245    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785248    2564 flags.go:64] FLAG: --eviction-soft=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785251    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785254    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785257    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785260    2564 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785263    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785266    2564 flags.go:64] FLAG: --fail-swap-on="true"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785269    2564 flags.go:64] FLAG: --feature-gates=""
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785274    2564 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785277    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 19:43:38.789244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785280    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785284    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785287    2564 flags.go:64] FLAG: --healthz-port="10248"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785290    2564 flags.go:64] FLAG: --help="false"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785293    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-195.ec2.internal"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785296    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785299    2564 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785302    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785305    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785308    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785311    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785314    2564 flags.go:64] FLAG: --image-service-endpoint=""
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785317    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785321    2564 flags.go:64] FLAG: --kube-api-burst="100"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785324    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785327    2564 flags.go:64] FLAG: --kube-api-qps="50"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785330    2564 flags.go:64] FLAG: --kube-reserved=""
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785333    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785336    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785339    2564 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785342    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785345    2564 flags.go:64] FLAG: --lock-file=""
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785348    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785351    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 19:43:38.789862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785354    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785359    2564 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785363    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785366    2564 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785369    2564 flags.go:64] FLAG: --logging-format="text"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785371    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785375    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785378    2564 flags.go:64] FLAG: --manifest-url=""
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785381    2564 flags.go:64] FLAG: --manifest-url-header=""
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785388    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785391    2564 flags.go:64] FLAG: --max-open-files="1000000"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785395    2564 flags.go:64] FLAG: --max-pods="110"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785399    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785402    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785405    2564 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785408    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785411    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785414    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785417    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785425    2564 flags.go:64] FLAG: --node-status-max-images="50"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785427    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785431    2564 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785434    2564 flags.go:64] FLAG: --pod-cidr=""
May 28 19:43:38.790521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785437    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785443    2564 flags.go:64] FLAG: --pod-manifest-path=""
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785446    2564 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785450    2564 flags.go:64] FLAG: --pods-per-core="0"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785453    2564 flags.go:64] FLAG: --port="10250"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785456    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785459    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0826181a18fbb496c"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785462    2564 flags.go:64] FLAG: --qos-reserved=""
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785465    2564 flags.go:64] FLAG: --read-only-port="10255"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785468    2564 flags.go:64] FLAG: --register-node="true"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785471    2564 flags.go:64] FLAG: --register-schedulable="true"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785474    2564 flags.go:64] FLAG: --register-with-taints=""
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785478    2564 flags.go:64] FLAG: --registry-burst="10"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785480    2564 flags.go:64] FLAG: --registry-qps="5"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785483    2564 flags.go:64] FLAG: --reserved-cpus=""
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785486    2564 flags.go:64] FLAG: --reserved-memory=""
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785491    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785494    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785497    2564 flags.go:64] FLAG: --rotate-certificates="false"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785500    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785503    2564 flags.go:64] FLAG: --runonce="false"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785506    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785509    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785512    2564 flags.go:64] FLAG: --seccomp-default="false"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785514    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785517    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 19:43:38.791075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785520    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785523    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785526    2564 flags.go:64] FLAG: --storage-driver-password="root"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785529    2564 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785532    2564 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785535    2564 flags.go:64] FLAG: --storage-driver-user="root"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785538    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785541    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785544    2564 flags.go:64] FLAG: --system-cgroups=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785547    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785552    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785555    2564 flags.go:64] FLAG: --tls-cert-file=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785558    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785565    2564 flags.go:64] FLAG: --tls-min-version=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785568    2564 flags.go:64] FLAG: --tls-private-key-file=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785571    2564 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785574    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785577    2564 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785580    2564 flags.go:64] FLAG: --v="2"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785584    2564 flags.go:64] FLAG: --version="false"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785588    2564 flags.go:64] FLAG: --vmodule=""
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785593    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785597    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785693    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:38.791719 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785697    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785700    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785702    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785705    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785708    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785710    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785713    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785715    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785718    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785721    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785723    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785726    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785728    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785731    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785734    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785737    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785739    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785742    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785748    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785751    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:38.792311 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785754    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785757    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785762    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785766    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785769    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785772    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785775    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785778    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785781    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785783    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785786    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785789    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785805    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785808    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785811    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785815    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785818    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785821    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785824    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:38.792814 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785826    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785829    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785832    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785834    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785837    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785840    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785843    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785846    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785849    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785852    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785855    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785859    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785862    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785865    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785872    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785875    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785878    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785880    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785883    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785885    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:38.793315 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785888    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785891    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785894    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785897    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785899    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785902    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785904    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785907    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785910    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785913    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785915    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785918    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785920    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785923    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785925    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785928    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785931    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785933    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785936    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785938    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:38.793813 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785941    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785943    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785947    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785951    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785954    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.785956    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.785963    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.792681    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.792697    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792755    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792760    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792764    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792767    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792770    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792774    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:38.794306 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792779    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792783    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792786    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792803    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792808    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792815    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792819    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792823    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792825    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792828    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792831    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792834    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792837    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792840    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792843    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792846    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792849    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792852    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792854    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792857    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:38.794678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792860    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792862    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792865    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792868    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792871    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792875    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792877    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792880    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792882    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792885    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792888    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792890    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792893    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792896    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792898    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792901    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792903    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792906    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792908    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:38.795191 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792910    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792913    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792916    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792919    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792921    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792924    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792927    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792929    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792932    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792934    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792937    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792939    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792942    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792944    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792947    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792949    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792952    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792955    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792958    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792961    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:38.795647 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792964    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792966    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792969    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792972    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792974    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792977    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792979    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792982    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792985    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792987    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792990    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792992    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792995    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.792997    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793001    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793003    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793006    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793009    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793011    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793014    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:38.796152 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793016    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.793021    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793150    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793155    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793158    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793162    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793165    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793168    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793170    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793173    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793176    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793178    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793183    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793186    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793189    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:38.796641 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793192    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793194    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793197    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793199    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793202    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793204    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793209    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793212    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793215    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793218    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793220    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793224    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793227    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793230    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793233    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793235    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793238    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793240    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793243    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:38.797025 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793246    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793248    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793251    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793254    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793256    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793259    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793261    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793264    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793267    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793269    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793272    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793274    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793277    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793280    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793282    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793285    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793287    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793290    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793292    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793295    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:38.797478 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793297    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793300    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793302    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793305    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793307    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793310    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793313    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793315    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793318    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793321    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793323    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793326    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793329    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793331    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793334    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793337    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793339    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793342    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793344    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793347    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793349    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:38.798034 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793352    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793355    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793357    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793360    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793363    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793365    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793368    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793370    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793373    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793375    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793377    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793380    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:38.793383    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.793387    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.794284    2564 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 19:43:38.798582 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.798331    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 19:43:38.799455 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.799443    2564 server.go:1019] "Starting client certificate rotation"
May 28 19:43:38.799561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.799545    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 19:43:38.799597 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.799580    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 19:43:38.829130 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.829108    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 19:43:38.830938 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.830909    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 19:43:38.844235 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.844215    2564 log.go:25] "Validated CRI v1 runtime API"
May 28 19:43:38.850343 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.850326    2564 log.go:25] "Validated CRI v1 image API"
May 28 19:43:38.854529 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.854510    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 19:43:38.858902 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.858880    2564 fs.go:135] Filesystem UUIDs: map[0776f080-9ecd-4549-b999-926ec0935c70:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a4413b86-d678-4d64-8975-f68952f9d8c8:/dev/nvme0n1p3]
May 28 19:43:38.858993 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.858903    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 19:43:38.862682 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.862655    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 19:43:38.863470 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.863356    2564 manager.go:217] Machine: {Timestamp:2026-05-28 19:43:38.862865099 +0000 UTC m=+0.468429519 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111854 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce141924869a07406d652594e8b5d SystemUUID:ec2ce141-9248-69a0-7406-d652594e8b5d BootID:dc12ebeb-f25c-4b97-905c-a55deb045957 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:ef:a0:a9:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:ef:a0:a9:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:8b:d7:28:ae:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 19:43:38.865103 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.865090    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 19:43:38.865236 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.865222    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 19:43:38.867542 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.867518    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 19:43:38.867676 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.867545    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 19:43:38.867718 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.867687    2564 topology_manager.go:138] "Creating topology manager with none policy"
May 28 19:43:38.867718 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.867696    2564 container_manager_linux.go:306] "Creating device plugin manager"
May 28 19:43:38.867718 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.867704    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 19:43:38.868601 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.868591    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 19:43:38.870896 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.870885    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 19:43:38.871012 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.871002    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 19:43:38.873754 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.873744    2564 kubelet.go:491] "Attempting to sync node with API server"
May 28 19:43:38.873809 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.873765    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 19:43:38.873809 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.873779    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 19:43:38.873809 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.873806    2564 kubelet.go:397] "Adding apiserver pod source"
May 28 19:43:38.873913 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.873818    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 19:43:38.874996 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.874985    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 19:43:38.875033 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.875004    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 19:43:38.878480 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.878448    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 19:43:38.881083 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.881069    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 19:43:38.882031 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882013    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 19:43:38.882031 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882032    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882039    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882048    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882061    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882068    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882074    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882080    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882086    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882097    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 19:43:38.882113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882115    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 19:43:38.882585 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.882576    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 19:43:38.883612 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.883602    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 19:43:38.883645 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.883614    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 19:43:38.884465 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.884447    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8lh9"
May 28 19:43:38.885207 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.885182    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 19:43:38.885251 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.885213    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 19:43:38.888189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.888173    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 19:43:38.888262 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.888213    2564 server.go:1295] "Started kubelet"
May 28 19:43:38.889134 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.889073    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 19:43:38.889226 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.889158    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 19:43:38.889297 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.889274    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 19:43:38.889607 ip-10-0-138-195 systemd[1]: Started Kubernetes Kubelet.
May 28 19:43:38.890567 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.890468    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 19:43:38.891674 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.891646    2564 server.go:317] "Adding debug handlers to kubelet server"
May 28 19:43:38.892805 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.892777    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8lh9"
May 28 19:43:38.896851 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.896835    2564 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 19:43:38.898056 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.896855    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-195.ec2.internal.18b3d238bdf14b8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-195.ec2.internal,UID:ip-10-0-138-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-195.ec2.internal,},FirstTimestamp:2026-05-28 19:43:38.888186765 +0000 UTC m=+0.493751186,LastTimestamp:2026-05-28 19:43:38.888186765 +0000 UTC m=+0.493751186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-195.ec2.internal,}"
May 28 19:43:38.899878 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.899859    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 19:43:38.899878 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.899872    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 19:43:38.900016 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.899935    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 19:43:38.900016 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.899945    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 19:43:38.900131 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.900073    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 19:43:38.900184 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.900135    2564 reconstruct.go:97] "Volume reconstruction finished"
May 28 19:43:38.900184 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.900141    2564 reconciler.go:26] "Reconciler: start to sync state"
May 28 19:43:38.900461 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.900434    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 19:43:38.900826 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.900807    2564 factory.go:55] Registering systemd factory
May 28 19:43:38.900919 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.900845    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:38.900919 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.900859    2564 factory.go:223] Registration of the systemd container factory successfully
May 28 19:43:38.901187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901084    2564 factory.go:153] Registering CRI-O factory
May 28 19:43:38.901187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901098    2564 factory.go:223] Registration of the crio container factory successfully
May 28 19:43:38.901187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901145    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 19:43:38.901187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901173    2564 factory.go:103] Registering Raw factory
May 28 19:43:38.901385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901193    2564 manager.go:1196] Started watching for new ooms in manager
May 28 19:43:38.901583 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.901568    2564 manager.go:319] Starting recovery of all containers
May 28 19:43:38.906730 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.906711    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:38.909480 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.909458    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-195.ec2.internal\" not found" node="ip-10-0-138-195.ec2.internal"
May 28 19:43:38.913488 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.913471    2564 manager.go:324] Recovery completed
May 28 19:43:38.917599 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.917586    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:38.920301 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.920277    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:38.920396 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.920314    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:38.920396 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.920336    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:38.921472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.921456    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 19:43:38.921472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.921469    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 19:43:38.921579 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.921485    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 19:43:38.925123 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.925109    2564 policy_none.go:49] "None policy: Start"
May 28 19:43:38.925174 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.925128    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 19:43:38.925174 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.925138    2564 state_mem.go:35] "Initializing new in-memory state store"
May 28 19:43:38.960381 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960366    2564 manager.go:341] "Starting Device Plugin manager"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.960402    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960416    2564 server.go:85] "Starting device plugin registration server"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960680    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960692    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960809    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960900    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:38.960910    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.961453    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 19:43:38.981062 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:38.961494    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.045085 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.044984    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 19:43:39.046141 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.046110    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 19:43:39.046141 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.046138    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 19:43:39.046306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.046160    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 19:43:39.046306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.046168    2564 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 19:43:39.046306 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.046242    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 19:43:39.053561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.053540    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:39.061737 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.061715    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:39.062651 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.062634    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:39.062751 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.062663    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:39.062751 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.062674    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:39.062751 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.062701    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-195.ec2.internal"
May 28 19:43:39.072167 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.072147    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-195.ec2.internal"
May 28 19:43:39.072229 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.072172    2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-195.ec2.internal\": node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.092673 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.092656    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.146519 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.146493    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"]
May 28 19:43:39.146621 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.146576    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:39.147527 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.147510    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:39.147601 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.147538    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:39.147601 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.147548    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:39.148664 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.148652    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:39.148835 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.148820    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.148872 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.148853    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:39.149334 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149319    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:39.149428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149331    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:39.149428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149349    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:39.149428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149351    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:39.149428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149363    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:39.149428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.149373    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:39.150433 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.150420    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.150476 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.150446    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:39.151130 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.151117    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:39.151189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.151144    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:39.151189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.151157    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:39.179604 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.179571    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-195.ec2.internal\" not found" node="ip-10-0-138-195.ec2.internal"
May 28 19:43:39.183988 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.183971    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-195.ec2.internal\" not found" node="ip-10-0-138-195.ec2.internal"
May 28 19:43:39.193037 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.193019    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.201694 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.201675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bae7945d9afb3043257c8a7ddde8e4a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-195.ec2.internal\" (UID: \"4bae7945d9afb3043257c8a7ddde8e4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.201768 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.201701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.201768 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.201721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.293486 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.293459    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.302890 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302839    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.302890 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302872    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.302989 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302892    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bae7945d9afb3043257c8a7ddde8e4a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-195.ec2.internal\" (UID: \"4bae7945d9afb3043257c8a7ddde8e4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.302989 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302943    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.303052 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bae7945d9afb3043257c8a7ddde8e4a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-195.ec2.internal\" (UID: \"4bae7945d9afb3043257c8a7ddde8e4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.303052 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.302940    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffa0c5937f282458035ee185ae4c6f8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal\" (UID: \"ffa0c5937f282458035ee185ae4c6f8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.394267 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.394230    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.482731 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.482702    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.486463 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.486440    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:39.495092 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.494965    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.595539 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.595456    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.695996 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.695963    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.796618 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.796591    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.799749 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.799731    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 19:43:39.799924 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.799909    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 19:43:39.799962 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.799928    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 19:43:39.895596 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.895555    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 19:38:38 +0000 UTC" deadline="2028-03-07 23:25:09.959468982 +0000 UTC"
May 28 19:43:39.895596 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.895590    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15579h41m30.063882194s"
May 28 19:43:39.897717 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.897696    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:39.900483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.900466    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 19:43:39.917189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.917161    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 19:43:39.937211 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.937184    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tmgz"
May 28 19:43:39.945147 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:39.945123    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7tmgz"
May 28 19:43:39.998547 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:39.998517    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:40.017435 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:40.017397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bae7945d9afb3043257c8a7ddde8e4a.slice/crio-c6dfa99ff1604c031494a731bcba8b4e56307a846c85fc7b40a9c4355a09b1ac WatchSource:0}: Error finding container c6dfa99ff1604c031494a731bcba8b4e56307a846c85fc7b40a9c4355a09b1ac: Status 404 returned error can't find the container with id c6dfa99ff1604c031494a731bcba8b4e56307a846c85fc7b40a9c4355a09b1ac
May 28 19:43:40.017678 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:40.017662    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa0c5937f282458035ee185ae4c6f8e.slice/crio-d98a2d1dc422201a04226b437277d091ef5370be2472fee9bed3d602ce6407c0 WatchSource:0}: Error finding container d98a2d1dc422201a04226b437277d091ef5370be2472fee9bed3d602ce6407c0: Status 404 returned error can't find the container with id d98a2d1dc422201a04226b437277d091ef5370be2472fee9bed3d602ce6407c0
May 28 19:43:40.021803 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.021768    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:43:40.049349 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.049308    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal" event={"ID":"4bae7945d9afb3043257c8a7ddde8e4a","Type":"ContainerStarted","Data":"c6dfa99ff1604c031494a731bcba8b4e56307a846c85fc7b40a9c4355a09b1ac"}
May 28 19:43:40.050212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.050193    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal" event={"ID":"ffa0c5937f282458035ee185ae4c6f8e","Type":"ContainerStarted","Data":"d98a2d1dc422201a04226b437277d091ef5370be2472fee9bed3d602ce6407c0"}
May 28 19:43:40.099364 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:40.099340    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:40.199848 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:40.199772    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-195.ec2.internal\" not found"
May 28 19:43:40.220973 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.220942    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:40.300365 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.300327    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal"
May 28 19:43:40.308519 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.308489    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 19:43:40.310739 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.310720    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal"
May 28 19:43:40.325470 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.325451    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 19:43:40.411051 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.411024    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:40.840561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.840530    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:40.865225 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.865192    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:40.875364 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.875333    2564 apiserver.go:52] "Watching apiserver"
May 28 19:43:40.882621 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.882594    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 19:43:40.885124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.885095    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-whhhh","openshift-image-registry/node-ca-gmtpj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal","openshift-multus/network-metrics-daemon-h5fjp","openshift-network-diagnostics/network-check-target-mpkxr","openshift-network-operator/iptables-alerter-f8lxl","kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf","openshift-multus/multus-additional-cni-plugins-j8bjr","openshift-multus/multus-zlz8q","openshift-ovn-kubernetes/ovnkube-node-w8gl6","kube-system/konnectivity-agent-zv5sb","openshift-cluster-node-tuning-operator/tuned-xh2qq"]
May 28 19:43:40.887734 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.887712    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.889868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.889766    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:40.890511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.890392    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 19:43:40.890511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.890432    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 19:43:40.890693 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.890556    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-298hk\""
May 28 19:43:40.890693 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.890592    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 19:43:40.890889 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.890768    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 19:43:40.891893 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.891875    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 19:43:40.891893 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.891893    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 19:43:40.892054 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.892027    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:40.892108 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.892095    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 19:43:40.892142 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:40.892111    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:40.892429 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.892406    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gd7wp\""
May 28 19:43:40.894261 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.894164    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:40.894261 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:40.894227    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:40.896199 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.896180    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:40.898416 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.898400    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.899423 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.899406    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7tpp\""
May 28 19:43:40.899529 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.899457    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 19:43:40.899721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.899704    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 19:43:40.899969 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.899956    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 19:43:40.900660 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.900637    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.900754 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.900672    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 19:43:40.900920 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.900855    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 19:43:40.901441 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.901422    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gqqgl\""
May 28 19:43:40.902700 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.902380    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 19:43:40.903318 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.902925    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 19:43:40.905266 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.903504    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:40.905266 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.903921    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 19:43:40.905266 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.903971    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-thjhm\""
May 28 19:43:40.905772 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.905754    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 19:43:40.906376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.906347    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g79r7\""
May 28 19:43:40.907374 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.907355    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 19:43:40.908493 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.908478    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:40.908889 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.908820    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910672    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910748    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dkhnm\""
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910814    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t9j\" (UniqueName: \"kubernetes.io/projected/b025fccc-b142-4d16-aa59-d884fbaf8949-kube-api-access-57t9j\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910866    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.910940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-daemon-config\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.910987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-multus-certs\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78rx\" (UniqueName: \"kubernetes.io/projected/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-kube-api-access-k78rx\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e94ca2f9-09f6-463d-8eaf-2a492b725d59-host-slash\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-cnibin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmh4j\" (UniqueName: \"kubernetes.io/projected/13055ac8-d738-4e60-80d2-c2774a5dafd4-kube-api-access-cmh4j\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n595k\" (UniqueName: \"kubernetes.io/projected/936095d3-eb33-4ba7-942b-07a94ea181c2-kube-api-access-n595k\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-device-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.911357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-cni-binary-copy\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-socket-dir-parent\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911393    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-k8s-cni-cncf-io\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-kubelet\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-os-release\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-cnibin\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911489    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-os-release\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-bin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911557    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-serviceca\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e94ca2f9-09f6-463d-8eaf-2a492b725d59-iptables-alerter-script\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911612    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckd8x\" (UniqueName: \"kubernetes.io/projected/e94ca2f9-09f6-463d-8eaf-2a492b725d59-kube-api-access-ckd8x\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-netns\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911692    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-multus\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.911935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-etc-kubernetes\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-system-cni-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911763    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sqlb\""
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911843    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-registration-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-sys-fs\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mksjm\" (UniqueName: \"kubernetes.io/projected/00b71335-fd9c-486b-82ee-6da00ce62931-kube-api-access-mksjm\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.911986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-host\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.912008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-socket-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.912027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-system-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.912066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-hostroot\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.912123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-conf-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:40.912812 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.912581    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 19:43:40.913550 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.913240    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 19:43:40.913904 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.913887    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 19:43:40.914281 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.914267    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wjx79\""
May 28 19:43:40.945942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.945904    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 19:38:39 +0000 UTC" deadline="2027-11-09 03:58:47.260298836 +0000 UTC"
May 28 19:43:40.946056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:40.945944    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12704h15m6.314362948s"
May 28 19:43:41.000890 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.000858    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 19:43:41.012539 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012508    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mksjm\" (UniqueName: \"kubernetes.io/projected/00b71335-fd9c-486b-82ee-6da00ce62931-kube-api-access-mksjm\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-script-lib\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-tuned\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012604    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-host\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-node-log\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-netd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-sys\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.012706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012706    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-system-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012723    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-host\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012729    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012785    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012787    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-system-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.012818    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcgxl\" (UniqueName: \"kubernetes.io/projected/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-kube-api-access-hcgxl\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-kubernetes\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.012889    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:41.512867326 +0000 UTC m=+3.118431752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-conf\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.012987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-var-lib-kubelet\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013014    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013034    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-daemon-config\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013055 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k78rx\" (UniqueName: \"kubernetes.io/projected/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-kube-api-access-k78rx\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013075    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e94ca2f9-09f6-463d-8eaf-2a492b725d59-host-slash\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013088    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-cni-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-ovn\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-modprobe-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013185    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e94ca2f9-09f6-463d-8eaf-2a492b725d59-host-slash\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-host\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013249    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-cnibin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013273    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n595k\" (UniqueName: \"kubernetes.io/projected/936095d3-eb33-4ba7-942b-07a94ea181c2-kube-api-access-n595k\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013312    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013329    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-cnibin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-device-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-systemd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013398    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013433    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.013649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013466    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-cni-binary-copy\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013478    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-device-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013491    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-k8s-cni-cncf-io\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013526    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-k8s-cni-cncf-io\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013539    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-kubelet\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013554    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-daemon-config\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013571    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-os-release\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013604    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-cnibin\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-kubelet\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013633    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013639    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-os-release\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013656    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-cnibin\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013658    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckd8x\" (UniqueName: \"kubernetes.io/projected/e94ca2f9-09f6-463d-8eaf-2a492b725d59-kube-api-access-ckd8x\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-bin\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-agent-certs\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013749    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013775    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-etc-kubernetes\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.014421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013816    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-system-cni-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013841    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-registration-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-etc-kubernetes\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013863    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-sys-fs\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013893    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-system-cni-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-env-overrides\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013955    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-sys-fs\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-lib-modules\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013991    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysconfig\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-tmp\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.013945    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b025fccc-b142-4d16-aa59-d884fbaf8949-cni-binary-copy\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014060    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-registration-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014075    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-socket-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-systemd-units\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-log-socket\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4hkt\" (UniqueName: \"kubernetes.io/projected/a73816e2-4fe3-46a9-b270-0d801e18be88-kube-api-access-h4hkt\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/936095d3-eb33-4ba7-942b-07a94ea181c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014182    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-hostroot\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014220    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-conf-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-socket-dir\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014269    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-hostroot\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-conf-dir\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014299    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014316    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57t9j\" (UniqueName: \"kubernetes.io/projected/b025fccc-b142-4d16-aa59-d884fbaf8949-kube-api-access-57t9j\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovn-node-metrics-cert\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014372    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-multus-certs\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-run\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014420    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmh4j\" (UniqueName: \"kubernetes.io/projected/13055ac8-d738-4e60-80d2-c2774a5dafd4-kube-api-access-cmh4j\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014445    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-multus-certs\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014451    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014489    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-var-lib-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.015868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-etc-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014586    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b71335-fd9c-486b-82ee-6da00ce62931-etc-selinux\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47x8m\" (UniqueName: \"kubernetes.io/projected/32123e62-1479-4b04-91e6-58df2f4fbcc6-kube-api-access-47x8m\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73816e2-4fe3-46a9-b270-0d801e18be88-tmp-dir\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014787    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-socket-dir-parent\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-netns\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-config\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014879    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-multus-socket-dir-parent\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-systemd\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014923    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/936095d3-eb33-4ba7-942b-07a94ea181c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014940    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-os-release\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.014987    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-bin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-os-release\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015034    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-serviceca\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015034    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-bin\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015069    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e94ca2f9-09f6-463d-8eaf-2a492b725d59-iptables-alerter-script\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.016558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-slash\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-konnectivity-ca\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015301    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-netns\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015326    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-multus\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-kubelet\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a73816e2-4fe3-46a9-b270-0d801e18be88-hosts-file\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015395    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-run-netns\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015408    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-serviceca\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015456    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b025fccc-b142-4d16-aa59-d884fbaf8949-host-var-lib-cni-multus\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.017245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.015616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e94ca2f9-09f6-463d-8eaf-2a492b725d59-iptables-alerter-script\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.019153 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.019129    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 19:43:41.020991 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.020900    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:41.020991 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.020922    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:41.020991 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.020934    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:41.021216 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.020998    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:41.520980061 +0000 UTC m=+3.126544486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:41.023551 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.023524    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78rx\" (UniqueName: \"kubernetes.io/projected/2c20ffc6-c827-4512-98b9-0e2b2732d4c5-kube-api-access-k78rx\") pod \"node-ca-gmtpj\" (UID: \"2c20ffc6-c827-4512-98b9-0e2b2732d4c5\") " pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.024224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.024168    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mksjm\" (UniqueName: \"kubernetes.io/projected/00b71335-fd9c-486b-82ee-6da00ce62931-kube-api-access-mksjm\") pod \"aws-ebs-csi-driver-node-5w6rf\" (UID: \"00b71335-fd9c-486b-82ee-6da00ce62931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.025500 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.024922    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckd8x\" (UniqueName: \"kubernetes.io/projected/e94ca2f9-09f6-463d-8eaf-2a492b725d59-kube-api-access-ckd8x\") pod \"iptables-alerter-f8lxl\" (UID: \"e94ca2f9-09f6-463d-8eaf-2a492b725d59\") " pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.025500 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.025057    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmh4j\" (UniqueName: \"kubernetes.io/projected/13055ac8-d738-4e60-80d2-c2774a5dafd4-kube-api-access-cmh4j\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:41.025500 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.025438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n595k\" (UniqueName: \"kubernetes.io/projected/936095d3-eb33-4ba7-942b-07a94ea181c2-kube-api-access-n595k\") pod \"multus-additional-cni-plugins-j8bjr\" (UID: \"936095d3-eb33-4ba7-942b-07a94ea181c2\") " pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.025757 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.025733    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t9j\" (UniqueName: \"kubernetes.io/projected/b025fccc-b142-4d16-aa59-d884fbaf8949-kube-api-access-57t9j\") pod \"multus-zlz8q\" (UID: \"b025fccc-b142-4d16-aa59-d884fbaf8949\") " pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.116644 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116558    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-netd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.116644 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116599    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-sys\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116645    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcgxl\" (UniqueName: \"kubernetes.io/projected/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-kube-api-access-hcgxl\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116669    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-kubernetes\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116686    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-conf\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116689    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-sys\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116681    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-netd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116731    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-kubernetes\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116768    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-var-lib-kubelet\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116816    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-ovn\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116825    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-conf\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116847    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-var-lib-kubelet\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116841    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-modprobe-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.116884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116880    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-ovn\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116885    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-host\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116942    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-systemd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116968    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.116992    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-host\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117004    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117012    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-modprobe-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117036    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-systemd\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117049    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-bin\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117050    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117090    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-agent-certs\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117117    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-cni-bin\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysctl-d\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117120    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117171    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-env-overrides\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117192    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-lib-modules\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.117389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117213    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysconfig\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117239    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-tmp\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117265    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-systemd-units\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117291    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-log-socket\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117321    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4hkt\" (UniqueName: \"kubernetes.io/projected/a73816e2-4fe3-46a9-b270-0d801e18be88-kube-api-access-h4hkt\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117343    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovn-node-metrics-cert\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117342    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-lib-modules\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117358    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-run\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117394    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-var-lib-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117410    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-run\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117428    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-etc-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117458    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117485    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47x8m\" (UniqueName: \"kubernetes.io/projected/32123e62-1479-4b04-91e6-58df2f4fbcc6-kube-api-access-47x8m\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117517    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73816e2-4fe3-46a9-b270-0d801e18be88-tmp-dir\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117532    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-log-socket\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117543    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-netns\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117578    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-systemd-units\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-run-netns\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.118240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117609    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-config\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117636    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-var-lib-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117637    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-systemd\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117676    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-slash\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-systemd\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-env-overrides\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117459    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-sysconfig\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117721    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-etc-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117738    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-run-openvswitch\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-konnectivity-ca\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-config\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.117862    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-konnectivity-ca\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118875    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-kubelet\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118910    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a73816e2-4fe3-46a9-b270-0d801e18be88-hosts-file\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118944    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-script-lib\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.118975    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-tuned\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119008    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-node-log\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a73816e2-4fe3-46a9-b270-0d801e18be88-tmp-dir\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.119077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119089    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-node-log\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.120059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119124    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a73816e2-4fe3-46a9-b270-0d801e18be88-hosts-file\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.120059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-kubelet\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.120059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119579    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovnkube-script-lib\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.120059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119721    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-host-slash\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.120059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.119924    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a7cfc36-1bee-41de-9d1b-a29eb66a259b-agent-certs\") pod \"konnectivity-agent-zv5sb\" (UID: \"1a7cfc36-1bee-41de-9d1b-a29eb66a259b\") " pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.120783 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.120756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-tmp\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.122029 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.121273    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-ovn-node-metrics-cert\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.122029 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.121507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32123e62-1479-4b04-91e6-58df2f4fbcc6-etc-tuned\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.125124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.125095    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcgxl\" (UniqueName: \"kubernetes.io/projected/f2db3f0f-90d3-47f2-a4aa-75d8d7482b55-kube-api-access-hcgxl\") pod \"ovnkube-node-w8gl6\" (UID: \"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.126655 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.126634    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47x8m\" (UniqueName: \"kubernetes.io/projected/32123e62-1479-4b04-91e6-58df2f4fbcc6-kube-api-access-47x8m\") pod \"tuned-xh2qq\" (UID: \"32123e62-1479-4b04-91e6-58df2f4fbcc6\") " pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.126756 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.126670    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4hkt\" (UniqueName: \"kubernetes.io/projected/a73816e2-4fe3-46a9-b270-0d801e18be88-kube-api-access-h4hkt\") pod \"node-resolver-whhhh\" (UID: \"a73816e2-4fe3-46a9-b270-0d801e18be88\") " pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.197631 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.197592    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlz8q"
May 28 19:43:41.207455 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.207416    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gmtpj"
May 28 19:43:41.218354 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.218330    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8lxl"
May 28 19:43:41.222991 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.222964    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf"
May 28 19:43:41.229589 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.229560    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8bjr"
May 28 19:43:41.236162 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.236139    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whhhh"
May 28 19:43:41.242778 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.242755    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:43:41.249417 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.249395    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:43:41.254995 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.254974    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xh2qq"
May 28 19:43:41.375362 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.375326    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7cfc36_1bee_41de_9d1b_a29eb66a259b.slice/crio-b64afcaf4d42e8564cc8c4c3797db727150104d091f3393a3b83d0e9f83dd639 WatchSource:0}: Error finding container b64afcaf4d42e8564cc8c4c3797db727150104d091f3393a3b83d0e9f83dd639: Status 404 returned error can't find the container with id b64afcaf4d42e8564cc8c4c3797db727150104d091f3393a3b83d0e9f83dd639
May 28 19:43:41.376599 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.376566    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb025fccc_b142_4d16_aa59_d884fbaf8949.slice/crio-5b6bb6429915d393bbe9d9ea02ed8e986ff9f80a50c07b4827eb3c4744064a81 WatchSource:0}: Error finding container 5b6bb6429915d393bbe9d9ea02ed8e986ff9f80a50c07b4827eb3c4744064a81: Status 404 returned error can't find the container with id 5b6bb6429915d393bbe9d9ea02ed8e986ff9f80a50c07b4827eb3c4744064a81
May 28 19:43:41.380697 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.380670    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c20ffc6_c827_4512_98b9_0e2b2732d4c5.slice/crio-b8892e3641a1645b9c87a9ff68136494c4dce2f9f3e8d3e2a188cd3b5ea8c044 WatchSource:0}: Error finding container b8892e3641a1645b9c87a9ff68136494c4dce2f9f3e8d3e2a188cd3b5ea8c044: Status 404 returned error can't find the container with id b8892e3641a1645b9c87a9ff68136494c4dce2f9f3e8d3e2a188cd3b5ea8c044
May 28 19:43:41.381453 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.381427    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936095d3_eb33_4ba7_942b_07a94ea181c2.slice/crio-9ec89ce67043e354d9c2c215c23fd78cdc9519803fbb6696ba3be174955ff012 WatchSource:0}: Error finding container 9ec89ce67043e354d9c2c215c23fd78cdc9519803fbb6696ba3be174955ff012: Status 404 returned error can't find the container with id 9ec89ce67043e354d9c2c215c23fd78cdc9519803fbb6696ba3be174955ff012
May 28 19:43:41.382713 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.382276    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73816e2_4fe3_46a9_b270_0d801e18be88.slice/crio-d304b985509b62154f46ce0c8100116a10828de8ecf00564ac2425e5d0a1e412 WatchSource:0}: Error finding container d304b985509b62154f46ce0c8100116a10828de8ecf00564ac2425e5d0a1e412: Status 404 returned error can't find the container with id d304b985509b62154f46ce0c8100116a10828de8ecf00564ac2425e5d0a1e412
May 28 19:43:41.383122 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.383100    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94ca2f9_09f6_463d_8eaf_2a492b725d59.slice/crio-98817b198db6ba3b77b18ee4b29521c2599ad815ad0c7abdafa716a8c0b7f06c WatchSource:0}: Error finding container 98817b198db6ba3b77b18ee4b29521c2599ad815ad0c7abdafa716a8c0b7f06c: Status 404 returned error can't find the container with id 98817b198db6ba3b77b18ee4b29521c2599ad815ad0c7abdafa716a8c0b7f06c
May 28 19:43:41.406081 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.406040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32123e62_1479_4b04_91e6_58df2f4fbcc6.slice/crio-c1159af4823d27d0fed909311b4c118c0e226166e84d1dc4b364ed4e7c2d8a9d WatchSource:0}: Error finding container c1159af4823d27d0fed909311b4c118c0e226166e84d1dc4b364ed4e7c2d8a9d: Status 404 returned error can't find the container with id c1159af4823d27d0fed909311b4c118c0e226166e84d1dc4b364ed4e7c2d8a9d
May 28 19:43:41.406944 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.406845    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2db3f0f_90d3_47f2_a4aa_75d8d7482b55.slice/crio-2730972dd7c32f3b80adf3e0a9478be9d9139cf92c793509434d8b52429f4b9e WatchSource:0}: Error finding container 2730972dd7c32f3b80adf3e0a9478be9d9139cf92c793509434d8b52429f4b9e: Status 404 returned error can't find the container with id 2730972dd7c32f3b80adf3e0a9478be9d9139cf92c793509434d8b52429f4b9e
May 28 19:43:41.408164 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:43:41.408139    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b71335_fd9c_486b_82ee_6da00ce62931.slice/crio-73ebd3c47959814c80b67b41b9a07e126eb3a5d8db4ba917cba47c7d7c2b2eef WatchSource:0}: Error finding container 73ebd3c47959814c80b67b41b9a07e126eb3a5d8db4ba917cba47c7d7c2b2eef: Status 404 returned error can't find the container with id 73ebd3c47959814c80b67b41b9a07e126eb3a5d8db4ba917cba47c7d7c2b2eef
May 28 19:43:41.522325 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.522296    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:41.522484 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.522335    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:41.522484 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522455    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:41.522484 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522458    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:41.522637 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522532    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:42.522510668 +0000 UTC m=+4.128075098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:41.522637 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522467    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:41.522637 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522559    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:41.522637 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:41.522607    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:42.522593817 +0000 UTC m=+4.128158237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:41.946861 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.946813    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 19:38:39 +0000 UTC" deadline="2028-02-16 12:42:24.307005158 +0000 UTC"
May 28 19:43:41.946861 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:41.946855    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15088h58m42.360153341s"
May 28 19:43:42.065378 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.064180    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal" event={"ID":"4bae7945d9afb3043257c8a7ddde8e4a","Type":"ContainerStarted","Data":"df9ba83f1a317144dc5f499514a76b2addf78aa8e00cd80e5ee6f343a112a9be"}
May 28 19:43:42.069699 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.069648    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whhhh" event={"ID":"a73816e2-4fe3-46a9-b270-0d801e18be88","Type":"ContainerStarted","Data":"d304b985509b62154f46ce0c8100116a10828de8ecf00564ac2425e5d0a1e412"}
May 28 19:43:42.075071 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.075019    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerStarted","Data":"9ec89ce67043e354d9c2c215c23fd78cdc9519803fbb6696ba3be174955ff012"}
May 28 19:43:42.078961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.078918    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlz8q" event={"ID":"b025fccc-b142-4d16-aa59-d884fbaf8949","Type":"ContainerStarted","Data":"5b6bb6429915d393bbe9d9ea02ed8e986ff9f80a50c07b4827eb3c4744064a81"}
May 28 19:43:42.084183 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.084130    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv5sb" event={"ID":"1a7cfc36-1bee-41de-9d1b-a29eb66a259b","Type":"ContainerStarted","Data":"b64afcaf4d42e8564cc8c4c3797db727150104d091f3393a3b83d0e9f83dd639"}
May 28 19:43:42.091700 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.091602    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf" event={"ID":"00b71335-fd9c-486b-82ee-6da00ce62931","Type":"ContainerStarted","Data":"73ebd3c47959814c80b67b41b9a07e126eb3a5d8db4ba917cba47c7d7c2b2eef"}
May 28 19:43:42.103126 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.102920    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"2730972dd7c32f3b80adf3e0a9478be9d9139cf92c793509434d8b52429f4b9e"}
May 28 19:43:42.111724 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.111614    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xh2qq" event={"ID":"32123e62-1479-4b04-91e6-58df2f4fbcc6","Type":"ContainerStarted","Data":"c1159af4823d27d0fed909311b4c118c0e226166e84d1dc4b364ed4e7c2d8a9d"}
May 28 19:43:42.116768 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.115642    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8lxl" event={"ID":"e94ca2f9-09f6-463d-8eaf-2a492b725d59","Type":"ContainerStarted","Data":"98817b198db6ba3b77b18ee4b29521c2599ad815ad0c7abdafa716a8c0b7f06c"}
May 28 19:43:42.118017 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.117886    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gmtpj" event={"ID":"2c20ffc6-c827-4512-98b9-0e2b2732d4c5","Type":"ContainerStarted","Data":"b8892e3641a1645b9c87a9ff68136494c4dce2f9f3e8d3e2a188cd3b5ea8c044"}
May 28 19:43:42.528449 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.528405    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:42.528609 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:42.528486    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:42.528668 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.528611    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:42.528713 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.528675    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:44.528654896 +0000 UTC m=+6.134219319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:42.533523 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.528953    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:42.533523 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.529021    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:42.533523 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.529032    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:42.533523 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:42.529076    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:44.529061623 +0000 UTC m=+6.134626046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:43.047005 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:43.046478    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:43.047005 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:43.046492    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:43.047005 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:43.046631    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:43.047005 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:43.046686    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:43.136321 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:43.135046    2564 generic.go:358] "Generic (PLEG): container finished" podID="ffa0c5937f282458035ee185ae4c6f8e" containerID="2342170d45fe3851f65c91c326d590ce8610ecf9985868eefde3b0fd3c9a3c23" exitCode=0
May 28 19:43:43.136321 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:43.135881    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal" event={"ID":"ffa0c5937f282458035ee185ae4c6f8e","Type":"ContainerDied","Data":"2342170d45fe3851f65c91c326d590ce8610ecf9985868eefde3b0fd3c9a3c23"}
May 28 19:43:43.154954 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:43.154871    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-195.ec2.internal" podStartSLOduration=3.154851667 podStartE2EDuration="3.154851667s" podCreationTimestamp="2026-05-28 19:43:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:43:42.082020007 +0000 UTC m=+3.687584437" watchObservedRunningTime="2026-05-28 19:43:43.154851667 +0000 UTC m=+4.760416098"
May 28 19:43:44.143229 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:44.143187    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal" event={"ID":"ffa0c5937f282458035ee185ae4c6f8e","Type":"ContainerStarted","Data":"b6121ad81d2274d175357898bf0bcb8784cc4088fdabe0c97c889c2969f82121"}
May 28 19:43:44.548513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:44.548363    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:44.548513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:44.548433    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548541    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548601    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548618    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548620    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:48.548599072 +0000 UTC m=+10.154163499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548630    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:44.548742 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:44.548680    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:48.548663958 +0000 UTC m=+10.154228386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:45.047035 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:45.046951    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:45.047199 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:45.047109    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:45.047553 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:45.047528    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:45.047667 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:45.047621    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:47.047821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:47.047450    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:47.047821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:47.047481    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:47.047821 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:47.047606    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:47.047821 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:47.047723    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:48.580589 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:48.580546    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:48.580623    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580700    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580728    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580743    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580763    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580817    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.580783376 +0000 UTC m=+18.186347791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:48.581077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:48.580838    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.580827938 +0000 UTC m=+18.186392350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:49.048345 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:49.047655    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:49.048345 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:49.047774    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:49.048345 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:49.048153    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:49.048345 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:49.048252    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:51.046620 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:51.046579    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:51.047077 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:51.046633    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:51.047077 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:51.046735    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:51.047193 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:51.047167    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:53.046420 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:53.046380    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:53.046420 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:53.046416    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:53.047046 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:53.046533    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:53.047046 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:53.046662    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:55.046648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:55.046505    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:55.046648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:55.046577    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:55.047164 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:55.046678    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:55.047164 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:55.046855    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:56.641315 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:56.641272    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:56.641334    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641441    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641443    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641533    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:12.641511096 +0000 UTC m=+34.247075526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641457    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641566    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:56.641765 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:56.641631    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:12.641613798 +0000 UTC m=+34.247178218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:57.047088 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:57.047006    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:57.047240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:57.047006    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:57.047240 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:57.047145    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:57.047240 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:57.047181    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:43:59.047273 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:59.047239    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:43:59.047884 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:59.047337    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:43:59.047884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:43:59.047387    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:43:59.047884 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:43:59.047465    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:00.174317 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.174288    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xh2qq" event={"ID":"32123e62-1479-4b04-91e6-58df2f4fbcc6","Type":"ContainerStarted","Data":"c0b9d83a645efd3c5ff552cf26fd6e6abfaacc257810ecb685a6d0dcbef9ba31"}
May 28 19:44:00.175648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.175621    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gmtpj" event={"ID":"2c20ffc6-c827-4512-98b9-0e2b2732d4c5","Type":"ContainerStarted","Data":"365e3ba41e4abd4e5f0d844717604409d4d0090163c29fe3ae2bc15c61f24b77"}
May 28 19:44:00.176779 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.176759    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whhhh" event={"ID":"a73816e2-4fe3-46a9-b270-0d801e18be88","Type":"ContainerStarted","Data":"23877cc48dd3843796a0f4cf8b98485a1fe247993e1d6a16ccf688b02e961a2a"}
May 28 19:44:00.178035 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.178012    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="e185e5649d6a84837e55e5895a3d46912840d9a0ed71d5c3f361a76c63a43f9b" exitCode=0
May 28 19:44:00.178109 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.178086    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"e185e5649d6a84837e55e5895a3d46912840d9a0ed71d5c3f361a76c63a43f9b"}
May 28 19:44:00.179357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.179324    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlz8q" event={"ID":"b025fccc-b142-4d16-aa59-d884fbaf8949","Type":"ContainerStarted","Data":"240b99e7c742bd3110a13af7ccb30dc9e17eca7d6a0a4e87377f174c2daaa687"}
May 28 19:44:00.180627 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.180594    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv5sb" event={"ID":"1a7cfc36-1bee-41de-9d1b-a29eb66a259b","Type":"ContainerStarted","Data":"559249fdc91c1d35dd37952a1d8e2c20a6ab955937fc3fbad807ba0c58ad0c05"}
May 28 19:44:00.181898 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.181876    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf" event={"ID":"00b71335-fd9c-486b-82ee-6da00ce62931","Type":"ContainerStarted","Data":"ea90dd2706111546fdd3d01c21624e4cb1d3c6a4fdb55f8cd344c5586c91fa86"}
May 28 19:44:00.183729 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.183713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:44:00.184010 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.183990    2564 generic.go:358] "Generic (PLEG): container finished" podID="f2db3f0f-90d3-47f2-a4aa-75d8d7482b55" containerID="6a2b635ffdc6f7c39d1ad57d7661cbf8bd0777ff2002bf857d944411f90ea59f" exitCode=1
May 28 19:44:00.184093 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.184022    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"da169f7b87a5d1976b03030c8727eaaad914bbbe85af940d41ec0bdbb5e7da74"}
May 28 19:44:00.184093 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.184041    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"ff35e231d40445ed0ada1bd7b23972c333b8d55591e1a231c0158ab1511a7470"}
May 28 19:44:00.184093 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.184060    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerDied","Data":"6a2b635ffdc6f7c39d1ad57d7661cbf8bd0777ff2002bf857d944411f90ea59f"}
May 28 19:44:00.184093 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.184074    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"09424003e0d601c084a11553ca0e5997c24c4b16e6d5145a862cf0fc51db3ac7"}
May 28 19:44:00.198997 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.198957    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-195.ec2.internal" podStartSLOduration=20.198944267 podStartE2EDuration="20.198944267s" podCreationTimestamp="2026-05-28 19:43:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:43:44.161681906 +0000 UTC m=+5.767246337" watchObservedRunningTime="2026-05-28 19:44:00.198944267 +0000 UTC m=+21.804508699"
May 28 19:44:00.199484 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.199455    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xh2qq" podStartSLOduration=3.100242046 podStartE2EDuration="21.199448534s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.410484275 +0000 UTC m=+3.016048684" lastFinishedPulling="2026-05-28 19:43:59.50969076 +0000 UTC m=+21.115255172" observedRunningTime="2026-05-28 19:44:00.199070419 +0000 UTC m=+21.804634827" watchObservedRunningTime="2026-05-28 19:44:00.199448534 +0000 UTC m=+21.805013004"
May 28 19:44:00.236562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.236515    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zlz8q" podStartSLOduration=3.068356946 podStartE2EDuration="21.236499886s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.378677747 +0000 UTC m=+2.984242156" lastFinishedPulling="2026-05-28 19:43:59.546820683 +0000 UTC m=+21.152385096" observedRunningTime="2026-05-28 19:44:00.235904081 +0000 UTC m=+21.841468508" watchObservedRunningTime="2026-05-28 19:44:00.236499886 +0000 UTC m=+21.842064317"
May 28 19:44:00.250414 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.250370    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gmtpj" podStartSLOduration=3.123131581 podStartE2EDuration="21.250356186s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.382336406 +0000 UTC m=+2.987900820" lastFinishedPulling="2026-05-28 19:43:59.509561017 +0000 UTC m=+21.115125425" observedRunningTime="2026-05-28 19:44:00.250193007 +0000 UTC m=+21.855757437" watchObservedRunningTime="2026-05-28 19:44:00.250356186 +0000 UTC m=+21.855920615"
May 28 19:44:00.280167 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.280110    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-whhhh" podStartSLOduration=3.17532145 podStartE2EDuration="21.280090985s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.404454063 +0000 UTC m=+3.010018470" lastFinishedPulling="2026-05-28 19:43:59.509223592 +0000 UTC m=+21.114788005" observedRunningTime="2026-05-28 19:44:00.264007561 +0000 UTC m=+21.869571990" watchObservedRunningTime="2026-05-28 19:44:00.280090985 +0000 UTC m=+21.885655416"
May 28 19:44:00.281012 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.280973    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zv5sb" podStartSLOduration=3.178662691 podStartE2EDuration="21.28096294s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.377435915 +0000 UTC m=+2.983000324" lastFinishedPulling="2026-05-28 19:43:59.479736158 +0000 UTC m=+21.085300573" observedRunningTime="2026-05-28 19:44:00.279856867 +0000 UTC m=+21.885421298" watchObservedRunningTime="2026-05-28 19:44:00.28096294 +0000 UTC m=+21.886527371"
May 28 19:44:00.965991 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.965965    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 19:44:00.972383 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.972297    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T19:44:00.965988338Z","UUID":"59110604-15c2-46b0-b662-538403aafadb","Handler":null,"Name":"","Endpoint":""}
May 28 19:44:00.973862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.973837    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 19:44:00.973862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:00.973863    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 19:44:01.046712 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.046679    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:01.046895 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.046696    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:01.046895 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:01.046836    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:01.046895 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:01.046866    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:01.186914 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.186828    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf" event={"ID":"00b71335-fd9c-486b-82ee-6da00ce62931","Type":"ContainerStarted","Data":"f95b135a6750fa069726fbd1c5223a08ac0545305c9fbda296ca075174d64ee6"}
May 28 19:44:01.189098 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.189078    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:44:01.189421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.189400    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"40ba4241226f6695047c5c522dac5e0658ee2f472f44300350958ccd211a13d8"}
May 28 19:44:01.189477 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.189432    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"e80129a82bff6e36ddcfc7e8c1ed7734a121a7b0c12111229c975a4aab937d9d"}
May 28 19:44:01.190605 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.190583    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8lxl" event={"ID":"e94ca2f9-09f6-463d-8eaf-2a492b725d59","Type":"ContainerStarted","Data":"e9df25c312aab51f5cfabfed979c6903cb731c84867c6e9942c4e7b2dced5f1a"}
May 28 19:44:01.206349 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.206293    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f8lxl" podStartSLOduration=4.101381686 podStartE2EDuration="22.206275847s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.404513416 +0000 UTC m=+3.010077825" lastFinishedPulling="2026-05-28 19:43:59.509407563 +0000 UTC m=+21.114971986" observedRunningTime="2026-05-28 19:44:01.205632943 +0000 UTC m=+22.811197377" watchObservedRunningTime="2026-05-28 19:44:01.206275847 +0000 UTC m=+22.811840279"
May 28 19:44:01.524132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:01.524043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whhhh_a73816e2-4fe3-46a9-b270-0d801e18be88/dns-node-resolver/0.log"
May 28 19:44:02.309100 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:02.309073    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gmtpj_2c20ffc6-c827-4512-98b9-0e2b2732d4c5/node-ca/0.log"
May 28 19:44:03.047272 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.047239    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:03.047455 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.047278    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:03.047455 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:03.047355    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:03.047571 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:03.047454    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:03.198543 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.198514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:44:03.198927 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.198900    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"78de0ca78a4062a5e1c4f2a2f7981a12faeef129a9a7e92133ec49c6c4191a9b"}
May 28 19:44:03.200774 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.200748    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf" event={"ID":"00b71335-fd9c-486b-82ee-6da00ce62931","Type":"ContainerStarted","Data":"93f5494be82037dcd95dc71cba716c96bf4a0a25bdaa0f03b2c2f5e3d710bc05"}
May 28 19:44:03.220850 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.220782    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5w6rf" podStartSLOduration=3.410953088 podStartE2EDuration="24.220761715s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.410583806 +0000 UTC m=+3.016148228" lastFinishedPulling="2026-05-28 19:44:02.220392409 +0000 UTC m=+23.825956855" observedRunningTime="2026-05-28 19:44:03.220417223 +0000 UTC m=+24.825981654" watchObservedRunningTime="2026-05-28 19:44:03.220761715 +0000 UTC m=+24.826326146"
May 28 19:44:03.939337 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.939304    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:44:03.940361 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:03.940336    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:44:04.203561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:04.203466    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:44:04.203861 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:04.203843    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zv5sb"
May 28 19:44:05.047066 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:05.046875    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:05.047487 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:05.046875    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:05.047487 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:05.047174    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:05.047487 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:05.047221    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:06.208007 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.207972    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="b5e18263a9a675794eeb87a28d0b42094ce60f20f43611f278f3b2693e96c2f7" exitCode=0
May 28 19:44:06.208447 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.208060    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"b5e18263a9a675794eeb87a28d0b42094ce60f20f43611f278f3b2693e96c2f7"}
May 28 19:44:06.211132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.211112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:44:06.211447 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.211428    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"5e18e9d6ba8e4448b275ea3035cec77fa0bac18818c2bb6cfaa6e37cde705a49"}
May 28 19:44:06.211975 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.211953    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:06.212149 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.212133    2564 scope.go:117] "RemoveContainer" containerID="6a2b635ffdc6f7c39d1ad57d7661cbf8bd0777ff2002bf857d944411f90ea59f"
May 28 19:44:06.228227 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:06.228204    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:07.046649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.046489    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:07.046808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.046515    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:07.046808 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:07.046711    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:07.046916 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:07.046833    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:07.216566 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.216487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:44:07.217018 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.216773    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" event={"ID":"f2db3f0f-90d3-47f2-a4aa-75d8d7482b55","Type":"ContainerStarted","Data":"27dcba453ae97f8da8208180be35a3fe35a14104502ff0158627770db8c2f4d4"}
May 28 19:44:07.217076 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.217029    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:07.217076 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.217057    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:07.218584 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.218558    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="6d729d0667b67048913e386200399b9e3bd1c1eadccabe612b133a4e0004b9d6" exitCode=0
May 28 19:44:07.218686 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.218599    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"6d729d0667b67048913e386200399b9e3bd1c1eadccabe612b133a4e0004b9d6"}
May 28 19:44:07.232704 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.232684    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:07.246721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:07.246681    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6" podStartSLOduration=10.06849373 podStartE2EDuration="28.246667173s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.410634407 +0000 UTC m=+3.016198819" lastFinishedPulling="2026-05-28 19:43:59.588807854 +0000 UTC m=+21.194372262" observedRunningTime="2026-05-28 19:44:07.246400396 +0000 UTC m=+28.851964826" watchObservedRunningTime="2026-05-28 19:44:07.246667173 +0000 UTC m=+28.852231604"
May 28 19:44:08.222525 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:08.222429    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="cb2be2c2e10194f0d3c93d15667efd5129c3de0e2b2cc9a5e8ef5ebf1d4c7fa0" exitCode=0
May 28 19:44:08.222900 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:08.222522    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"cb2be2c2e10194f0d3c93d15667efd5129c3de0e2b2cc9a5e8ef5ebf1d4c7fa0"}
May 28 19:44:09.048013 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:09.047975    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:09.048240 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:09.048101    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:09.048240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:09.048154    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:09.048343 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:09.048244    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:11.047026 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:11.046992    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:11.047598 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:11.046992    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:11.047598 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:11.047134    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:11.047598 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:11.047212    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:12.659102 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:12.659061    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:12.659138    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659235    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659275    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659289    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659299    2564 projected.go:194] Error preparing data for projected volume kube-api-access-znfp2 for pod openshift-network-diagnostics/network-check-target-mpkxr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659326    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs podName:13055ac8-d738-4e60-80d2-c2774a5dafd4 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:44.659303858 +0000 UTC m=+66.264868285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs") pod "network-metrics-daemon-h5fjp" (UID: "13055ac8-d738-4e60-80d2-c2774a5dafd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:44:12.659672 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:12.659346    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2 podName:4b732133-b5a5-4092-8aaf-8a90b7bcd410 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:44.659336111 +0000 UTC m=+66.264900526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-znfp2" (UniqueName: "kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2") pod "network-check-target-mpkxr" (UID: "4b732133-b5a5-4092-8aaf-8a90b7bcd410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:44:13.046713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:13.046613    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:13.046713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:13.046660    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:13.046947 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:13.046764    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:13.046947 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:13.046906    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:15.046890 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:15.046837    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:15.047409 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:15.046845    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:15.047409 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:15.046969    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:15.047409 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:15.047060    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:17.046323 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:17.046294    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:17.046684 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:17.046339    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:17.046684 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:17.046402    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:17.046684 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:17.046499    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:17.241380 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:17.241342    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="8bae08fcc9dd287c141579174399f0f2ce8ed1f2b5471529a5700bee71fde413" exitCode=0
May 28 19:44:17.241532 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:17.241395    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"8bae08fcc9dd287c141579174399f0f2ce8ed1f2b5471529a5700bee71fde413"}
May 28 19:44:18.245843 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:18.245806    2564 generic.go:358] "Generic (PLEG): container finished" podID="936095d3-eb33-4ba7-942b-07a94ea181c2" containerID="0fd9f44b7ba34896962868c355ed675b3c8fc6b079ce23839d140eaedf479811" exitCode=0
May 28 19:44:18.246321 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:18.245871    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerDied","Data":"0fd9f44b7ba34896962868c355ed675b3c8fc6b079ce23839d140eaedf479811"}
May 28 19:44:19.047968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:19.047933    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:19.047968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:19.047957    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:19.048167 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:19.048076    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:19.048213 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:19.048191    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:19.251091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:19.251057    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" event={"ID":"936095d3-eb33-4ba7-942b-07a94ea181c2","Type":"ContainerStarted","Data":"d0c42e73b856e85e08c1247b1cf4afe5ff5c0249979c658ee1463570db41f0a1"}
May 28 19:44:19.274636 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:19.274585    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j8bjr" podStartSLOduration=5.360772505 podStartE2EDuration="40.274571369s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:41.404482398 +0000 UTC m=+3.010046806" lastFinishedPulling="2026-05-28 19:44:16.318281259 +0000 UTC m=+37.923845670" observedRunningTime="2026-05-28 19:44:19.272856921 +0000 UTC m=+40.878421351" watchObservedRunningTime="2026-05-28 19:44:19.274571369 +0000 UTC m=+40.880135799"
May 28 19:44:21.047000 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.046970    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:21.047350 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:21.047098    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:21.047350 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.047143    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:21.047350 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:21.047230    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:21.765027 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.764854    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5fjp"]
May 28 19:44:21.765202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.765138    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:21.765281 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:21.765243    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:21.767310 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.767282    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpkxr"]
May 28 19:44:21.767422 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:21.767411    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:21.767530 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:21.767511    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:23.049471 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:23.049439    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:23.049914 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:23.049569    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:24.046727 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:24.046691    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:24.046919 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:24.046816    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:25.046772 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:25.046735    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:25.047224 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:25.046899    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5fjp" podUID="13055ac8-d738-4e60-80d2-c2774a5dafd4"
May 28 19:44:26.046565 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.046534    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:26.046743 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:26.046639    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpkxr" podUID="4b732133-b5a5-4092-8aaf-8a90b7bcd410"
May 28 19:44:26.709406 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.709381    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-195.ec2.internal" event="NodeReady"
May 28 19:44:26.709771 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.709511    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 19:44:26.757591 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.757560    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t48tq"]
May 28 19:44:26.790702 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.790668    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z574s"]
May 28 19:44:26.790870 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.790832    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.793451 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.793433    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 19:44:26.793574 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.793537    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 19:44:26.793685 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.793668    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mqs6v\""
May 28 19:44:26.804132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.804108    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t48tq"]
May 28 19:44:26.804132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.804132    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z574s"]
May 28 19:44:26.804260 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.804227    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.807633 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.807485    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 19:44:26.807633 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.807510    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 19:44:26.807833 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.807743    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 19:44:26.807833 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.807774    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 19:44:26.807950 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.807899    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5qmfg\""
May 28 19:44:26.858550 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.858518    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m5tnv"]
May 28 19:44:26.868073 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a67e8328-2f24-414e-91c3-618d5da4d522-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.868248 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a67e8328-2f24-414e-91c3-618d5da4d522-data-volume\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.868248 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a67e8328-2f24-414e-91c3-618d5da4d522-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.868248 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwwl\" (UniqueName: \"kubernetes.io/projected/a67e8328-2f24-414e-91c3-618d5da4d522-kube-api-access-mdwwl\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.868248 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-config-volume\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.868248 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6n2\" (UniqueName: \"kubernetes.io/projected/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-kube-api-access-qz6n2\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.868494 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a67e8328-2f24-414e-91c3-618d5da4d522-crio-socket\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.868494 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-metrics-tls\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.868494 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.868319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-tmp-dir\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.873376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.873352    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5tnv"]
May 28 19:44:26.873499 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.873483    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:26.876292 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.876269    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 19:44:26.876408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.876292    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 19:44:26.876408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.876318    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 19:44:26.876408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.876269    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mmzwh\""
May 28 19:44:26.969138 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969058    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a67e8328-2f24-414e-91c3-618d5da4d522-data-volume\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969138 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969113    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a67e8328-2f24-414e-91c3-618d5da4d522-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969367 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969147    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwwl\" (UniqueName: \"kubernetes.io/projected/a67e8328-2f24-414e-91c3-618d5da4d522-kube-api-access-mdwwl\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969367 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969172    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-config-volume\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.969367 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969196    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6n2\" (UniqueName: \"kubernetes.io/projected/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-kube-api-access-qz6n2\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.969367 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969221    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a67e8328-2f24-414e-91c3-618d5da4d522-crio-socket\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a67e8328-2f24-414e-91c3-618d5da4d522-crio-socket\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/484bf113-6195-49a0-8aec-83ec8999522e-cert\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a67e8328-2f24-414e-91c3-618d5da4d522-data-volume\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969472    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-metrics-tls\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969506    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-tmp-dir\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.969570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnbj2\" (UniqueName: \"kubernetes.io/projected/484bf113-6195-49a0-8aec-83ec8999522e-kube-api-access-lnbj2\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:26.969769 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969577    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a67e8328-2f24-414e-91c3-618d5da4d522-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.969826 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969812    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-tmp-dir\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.969932 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.969912    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-config-volume\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.970030 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.970012    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a67e8328-2f24-414e-91c3-618d5da4d522-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.973253 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.973220    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a67e8328-2f24-414e-91c3-618d5da4d522-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:26.973253 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.973227    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-metrics-tls\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.978110 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.978090    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6n2\" (UniqueName: \"kubernetes.io/projected/c2f2f9f1-44b8-4bf7-87d6-612960b21c5a-kube-api-access-qz6n2\") pod \"dns-default-t48tq\" (UID: \"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a\") " pod="openshift-dns/dns-default-t48tq"
May 28 19:44:26.978110 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:26.978104    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwwl\" (UniqueName: \"kubernetes.io/projected/a67e8328-2f24-414e-91c3-618d5da4d522-kube-api-access-mdwwl\") pod \"insights-runtime-extractor-z574s\" (UID: \"a67e8328-2f24-414e-91c3-618d5da4d522\") " pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:27.047298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.047267    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:27.049911 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.049884    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 19:44:27.050024 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.049926    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-msmgn\""
May 28 19:44:27.070579 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.070552    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnbj2\" (UniqueName: \"kubernetes.io/projected/484bf113-6195-49a0-8aec-83ec8999522e-kube-api-access-lnbj2\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:27.070688 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.070615    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/484bf113-6195-49a0-8aec-83ec8999522e-cert\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:27.072910 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.072885    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/484bf113-6195-49a0-8aec-83ec8999522e-cert\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:27.078342 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.078321    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnbj2\" (UniqueName: \"kubernetes.io/projected/484bf113-6195-49a0-8aec-83ec8999522e-kube-api-access-lnbj2\") pod \"ingress-canary-m5tnv\" (UID: \"484bf113-6195-49a0-8aec-83ec8999522e\") " pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:27.099808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.099768    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t48tq"
May 28 19:44:27.106738 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.106714    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"]
May 28 19:44:27.113035 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.113015    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z574s"
May 28 19:44:27.138570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.137530    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"]
May 28 19:44:27.138570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.137866    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.141090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141062    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 19:44:27.141224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141150    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kv84f\""
May 28 19:44:27.141224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141064    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 19:44:27.141355 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141340    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 19:44:27.141407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141371    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 19:44:27.141461 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.141455    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 19:44:27.170939 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.170907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.170939 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.170940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.171122 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.170960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg59s\" (UniqueName: \"kubernetes.io/projected/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-kube-api-access-lg59s\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.171122 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.171041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.181915 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.181888    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5tnv"
May 28 19:44:27.271821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.271673    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.271821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.271719    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.271821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.271762    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lg59s\" (UniqueName: \"kubernetes.io/projected/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-kube-api-access-lg59s\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.272101 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.271836    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.272770 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.272740    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.275439 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.275399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.275574 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.275552    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.281115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.281089    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg59s\" (UniqueName: \"kubernetes.io/projected/ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6-kube-api-access-lg59s\") pod \"prometheus-operator-7779bbdd78-brbxt\" (UID: \"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.291510 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.291455    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t48tq"]
May 28 19:44:27.294057 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.294037    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z574s"]
May 28 19:44:27.295749 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:27.295707    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f2f9f1_44b8_4bf7_87d6_612960b21c5a.slice/crio-83cf3a6ccadecf88c80a31adf99bd82776c610968f4800401cdfcb8cfc82a09f WatchSource:0}: Error finding container 83cf3a6ccadecf88c80a31adf99bd82776c610968f4800401cdfcb8cfc82a09f: Status 404 returned error can't find the container with id 83cf3a6ccadecf88c80a31adf99bd82776c610968f4800401cdfcb8cfc82a09f
May 28 19:44:27.297091 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:27.297061    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67e8328_2f24_414e_91c3_618d5da4d522.slice/crio-57607bb7f64a503802425098f9d21829ff82074e945eeb8250e1eae6aa1b2524 WatchSource:0}: Error finding container 57607bb7f64a503802425098f9d21829ff82074e945eeb8250e1eae6aa1b2524: Status 404 returned error can't find the container with id 57607bb7f64a503802425098f9d21829ff82074e945eeb8250e1eae6aa1b2524
May 28 19:44:27.338203 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.336261    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5tnv"]
May 28 19:44:27.341321 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:27.341294    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484bf113_6195_49a0_8aec_83ec8999522e.slice/crio-71b3a8c074c8582d74bb97ae223382d0e31f4597e37586215057a6eb47cbe31b WatchSource:0}: Error finding container 71b3a8c074c8582d74bb97ae223382d0e31f4597e37586215057a6eb47cbe31b: Status 404 returned error can't find the container with id 71b3a8c074c8582d74bb97ae223382d0e31f4597e37586215057a6eb47cbe31b
May 28 19:44:27.450336 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.450296    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"
May 28 19:44:27.571201 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:27.571169    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-brbxt"]
May 28 19:44:27.575538 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:27.575507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcebd68_6b7a_4d36_b4e6_d8feeec27ed6.slice/crio-05fc55429a280bfc89191d271f0c936e867dbb26690b680e6a3c6848ab89304d WatchSource:0}: Error finding container 05fc55429a280bfc89191d271f0c936e867dbb26690b680e6a3c6848ab89304d: Status 404 returned error can't find the container with id 05fc55429a280bfc89191d271f0c936e867dbb26690b680e6a3c6848ab89304d
May 28 19:44:28.047028 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.046989    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:28.050096 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.049908    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 19:44:28.050703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.050676    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 19:44:28.050828 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.050683    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-622pq\""
May 28 19:44:28.270612 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.270570    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z574s" event={"ID":"a67e8328-2f24-414e-91c3-618d5da4d522","Type":"ContainerStarted","Data":"f69e967307e3c65d77929dc9d55f0ae1775f5b5427215b3f73ca06ea094a07d1"}
May 28 19:44:28.270804 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.270623    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z574s" event={"ID":"a67e8328-2f24-414e-91c3-618d5da4d522","Type":"ContainerStarted","Data":"57607bb7f64a503802425098f9d21829ff82074e945eeb8250e1eae6aa1b2524"}
May 28 19:44:28.271847 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.271820    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt" event={"ID":"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6","Type":"ContainerStarted","Data":"05fc55429a280bfc89191d271f0c936e867dbb26690b680e6a3c6848ab89304d"}
May 28 19:44:28.272919 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.272891    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t48tq" event={"ID":"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a","Type":"ContainerStarted","Data":"83cf3a6ccadecf88c80a31adf99bd82776c610968f4800401cdfcb8cfc82a09f"}
May 28 19:44:28.274073 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:28.274046    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5tnv" event={"ID":"484bf113-6195-49a0-8aec-83ec8999522e","Type":"ContainerStarted","Data":"71b3a8c074c8582d74bb97ae223382d0e31f4597e37586215057a6eb47cbe31b"}
May 28 19:44:30.260513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.260488    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:44:30.288622 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.288597    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:44:30.288753 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.288714    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.291781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.291755    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 19:44:30.291947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.291846    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6qstw\""
May 28 19:44:30.291947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.291850    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 19:44:30.291947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.291928    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 19:44:30.292156 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.291929    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 19:44:30.292719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.292699    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 19:44:30.292868 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.292699    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 19:44:30.292931 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.292707    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 19:44:30.411745 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.411716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.411745 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.411750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nw8x\" (UniqueName: \"kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.411933 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.411803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.411933 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.411896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.412002 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.411945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.412034 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.412023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.512773 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.512747    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.512895 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.512786    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.512980 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.512960    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513021    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513090 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513085    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nw8x\" (UniqueName: \"kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513191 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513143    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513761 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513599    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513761 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513721    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.513761 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.513745    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.516600 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.516581    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.516707 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.516688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.521915 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.521891    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nw8x\" (UniqueName: \"kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x\") pod \"console-7db9b54d49-qkjtc\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") " pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.598170 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.598147    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:30.741016 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:30.740946    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:44:30.744044 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:30.744020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cad5295_0347_496e_acd0_cc68b9fd05b1.slice/crio-e41fca68b93abc275551d415567401da13b007b892b53076e032d70afc678393 WatchSource:0}: Error finding container e41fca68b93abc275551d415567401da13b007b892b53076e032d70afc678393: Status 404 returned error can't find the container with id e41fca68b93abc275551d415567401da13b007b892b53076e032d70afc678393
May 28 19:44:31.286051 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.286016    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z574s" event={"ID":"a67e8328-2f24-414e-91c3-618d5da4d522","Type":"ContainerStarted","Data":"d442529b66501ff82b9a001343317e65c49835d51a62700b88894edaa9da0672"}
May 28 19:44:31.287375 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.287348    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db9b54d49-qkjtc" event={"ID":"2cad5295-0347-496e-acd0-cc68b9fd05b1","Type":"ContainerStarted","Data":"e41fca68b93abc275551d415567401da13b007b892b53076e032d70afc678393"}
May 28 19:44:31.288995 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.288967    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt" event={"ID":"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6","Type":"ContainerStarted","Data":"830b752a57c0e723bb176a8d24a46dc500e155ad5e7f07380d5935b9a0647778"}
May 28 19:44:31.289124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.289002    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt" event={"ID":"ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6","Type":"ContainerStarted","Data":"b4b1a4cb9ce4039c3150cf26e05d58910a5524ee8563e87ec90f874630320779"}
May 28 19:44:31.290706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.290681    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t48tq" event={"ID":"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a","Type":"ContainerStarted","Data":"bd81b27f67d6f4e332f98134d9edd444485fe18101340652c716af0e16c5aa49"}
May 28 19:44:31.290838 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.290709    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t48tq" event={"ID":"c2f2f9f1-44b8-4bf7-87d6-612960b21c5a","Type":"ContainerStarted","Data":"81999cc11bd1771e57e7fbabf0c48b105f0601c02df352aa90ddc421abf8c5f3"}
May 28 19:44:31.290838 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.290785    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t48tq"
May 28 19:44:31.291752 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.291732    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5tnv" event={"ID":"484bf113-6195-49a0-8aec-83ec8999522e","Type":"ContainerStarted","Data":"aa82a47680c0a927c71c945fa1bcca041c178f04d54c841560b6674a195e73a5"}
May 28 19:44:31.307395 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.307355    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-brbxt" podStartSLOduration=1.451427996 podStartE2EDuration="4.307343002s" podCreationTimestamp="2026-05-28 19:44:27 +0000 UTC" firstStartedPulling="2026-05-28 19:44:27.577302868 +0000 UTC m=+49.182867276" lastFinishedPulling="2026-05-28 19:44:30.433217853 +0000 UTC m=+52.038782282" observedRunningTime="2026-05-28 19:44:31.306553325 +0000 UTC m=+52.912117756" watchObservedRunningTime="2026-05-28 19:44:31.307343002 +0000 UTC m=+52.912907432"
May 28 19:44:31.322892 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:31.322849    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t48tq" podStartSLOduration=2.428097233 podStartE2EDuration="5.322836006s" podCreationTimestamp="2026-05-28 19:44:26 +0000 UTC" firstStartedPulling="2026-05-28 19:44:27.29774218 +0000 UTC m=+48.903306605" lastFinishedPulling="2026-05-28 19:44:30.192480953 +0000 UTC m=+51.798045378" observedRunningTime="2026-05-28 19:44:31.322378483 +0000 UTC m=+52.927942916" watchObservedRunningTime="2026-05-28 19:44:31.322836006 +0000 UTC m=+52.928400436"
May 28 19:44:32.297190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:32.296893    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z574s" event={"ID":"a67e8328-2f24-414e-91c3-618d5da4d522","Type":"ContainerStarted","Data":"078167c281d43ca744904ad2fad067a602c69c4efc5b800dc03d98c33cb28072"}
May 28 19:44:32.317526 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:32.317017    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m5tnv" podStartSLOduration=3.467554227 podStartE2EDuration="6.316999413s" podCreationTimestamp="2026-05-28 19:44:26 +0000 UTC" firstStartedPulling="2026-05-28 19:44:27.343214077 +0000 UTC m=+48.948778488" lastFinishedPulling="2026-05-28 19:44:30.192659252 +0000 UTC m=+51.798223674" observedRunningTime="2026-05-28 19:44:31.336864803 +0000 UTC m=+52.942429233" watchObservedRunningTime="2026-05-28 19:44:32.316999413 +0000 UTC m=+53.922563845"
May 28 19:44:32.317526 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:32.317217    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z574s" podStartSLOduration=1.83178376 podStartE2EDuration="6.317210784s" podCreationTimestamp="2026-05-28 19:44:26 +0000 UTC" firstStartedPulling="2026-05-28 19:44:27.41287638 +0000 UTC m=+49.018440803" lastFinishedPulling="2026-05-28 19:44:31.898303416 +0000 UTC m=+53.503867827" observedRunningTime="2026-05-28 19:44:32.316491634 +0000 UTC m=+53.922056090" watchObservedRunningTime="2026-05-28 19:44:32.317210784 +0000 UTC m=+53.922775216"
May 28 19:44:33.467967 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.467936    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-49klv"]
May 28 19:44:33.483017 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.482988    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-49klv"]
May 28 19:44:33.483017 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.483024    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"]
May 28 19:44:33.483235 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.483133    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.485818 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.485521    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 19:44:33.485818 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.485641    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 19:44:33.485818 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.485750    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jvhxq\""
May 28 19:44:33.497035 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.497016    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.500284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.499878    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v25cg\""
May 28 19:44:33.500284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.499986    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 19:44:33.500284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.500100    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 19:44:33.500284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.500201    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 19:44:33.501487 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.501468    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"]
May 28 19:44:33.509922 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.509899    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ggtpt"]
May 28 19:44:33.530852 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.530825    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.533430 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.533397    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 19:44:33.533430 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.533411    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nnht5\""
May 28 19:44:33.533710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.533694    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 19:44:33.533965 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.533943    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 19:44:33.538331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5cqx\" (UniqueName: \"kubernetes.io/projected/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-kube-api-access-l5cqx\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.538331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.538331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.538511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlnt\" (UniqueName: \"kubernetes.io/projected/3d0441e7-9dff-424a-9d67-8531795090ef-kube-api-access-rdlnt\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d0441e7-9dff-424a-9d67-8531795090ef-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.538713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.538545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.639580 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639549    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639586    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639616    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlnt\" (UniqueName: \"kubernetes.io/projected/3d0441e7-9dff-424a-9d67-8531795090ef-kube-api-access-rdlnt\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639641    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpp4n\" (UniqueName: \"kubernetes.io/projected/7b19a241-0516-4342-a24d-49aee3d367a6-kube-api-access-hpp4n\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639717    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.639758 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:33.639717    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:33.639821    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls podName:3d0441e7-9dff-424a-9d67-8531795090ef nodeName:}" failed. No retries permitted until 2026-05-28 19:44:34.139781953 +0000 UTC m=+55.745346362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-ndkzz" (UID: "3d0441e7-9dff-424a-9d67-8531795090ef") : secret "kube-state-metrics-tls" not found
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639842    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639877    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d0441e7-9dff-424a-9d67-8531795090ef-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-sys\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639966    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.639995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-tls\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640075 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-wtmp\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-metrics-client-ca\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5cqx\" (UniqueName: \"kubernetes.io/projected/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-kube-api-access-l5cqx\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-root\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-textfile\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640196    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:33.640297    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:33.640337    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls podName:c189b147-1c12-44dd-baa4-5c5ff4f1aea1 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:34.140324451 +0000 UTC m=+55.745888887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-49klv" (UID: "c189b147-1c12-44dd-baa4-5c5ff4f1aea1") : secret "openshift-state-metrics-tls" not found
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d0441e7-9dff-424a-9d67-8531795090ef-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.640528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640443    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.640935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640586    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.640935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.640688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.644457 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.644427    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.644587 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.644460    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.648840 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.648816    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlnt\" (UniqueName: \"kubernetes.io/projected/3d0441e7-9dff-424a-9d67-8531795090ef-kube-api-access-rdlnt\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:33.649119 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.649097    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5cqx\" (UniqueName: \"kubernetes.io/projected/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-kube-api-access-l5cqx\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:33.741472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741381    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-metrics-client-ca\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741421    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-root\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741441    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-textfile\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741510    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpp4n\" (UniqueName: \"kubernetes.io/projected/7b19a241-0516-4342-a24d-49aee3d367a6-kube-api-access-hpp4n\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741563    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-sys\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741580    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-root\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741601    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-tls\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741666    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741703    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-wtmp\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.741743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741736    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-sys\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.742108 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741874    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-wtmp\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.742108 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.741912    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-textfile\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.742108 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.742083    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-metrics-client-ca\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.742346 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.742322    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.744246 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.744221    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.744376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.744352    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b19a241-0516-4342-a24d-49aee3d367a6-node-exporter-tls\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.751372 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.751347    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpp4n\" (UniqueName: \"kubernetes.io/projected/7b19a241-0516-4342-a24d-49aee3d367a6-kube-api-access-hpp4n\") pod \"node-exporter-ggtpt\" (UID: \"7b19a241-0516-4342-a24d-49aee3d367a6\") " pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:33.841736 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:33.841703    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggtpt"
May 28 19:44:34.144858 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.144820    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:34.145041 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.144867    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:34.145041 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.144986    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 19:44:34.145192 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.145039    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 19:44:34.145192 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.145067    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls podName:c189b147-1c12-44dd-baa4-5c5ff4f1aea1 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:35.145046925 +0000 UTC m=+56.750611338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-49klv" (UID: "c189b147-1c12-44dd-baa4-5c5ff4f1aea1") : secret "openshift-state-metrics-tls" not found
May 28 19:44:34.145192 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.145109    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls podName:3d0441e7-9dff-424a-9d67-8531795090ef nodeName:}" failed. No retries permitted until 2026-05-28 19:44:35.145090764 +0000 UTC m=+56.750655195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-ndkzz" (UID: "3d0441e7-9dff-424a-9d67-8531795090ef") : secret "kube-state-metrics-tls" not found
May 28 19:44:34.345831 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:34.345784    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b19a241_0516_4342_a24d_49aee3d367a6.slice/crio-bec4f46f0e175b99f40a34798f4e8110e79e85ed7116721ecb0cf9254d96766f WatchSource:0}: Error finding container bec4f46f0e175b99f40a34798f4e8110e79e85ed7116721ecb0cf9254d96766f: Status 404 returned error can't find the container with id bec4f46f0e175b99f40a34798f4e8110e79e85ed7116721ecb0cf9254d96766f
May 28 19:44:34.528345 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.528263    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:44:34.545536 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.545509    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.548644 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.548611    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 19:44:34.548644 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.548631    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 19:44:34.548876 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.548633    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 19:44:34.556464 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556409    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 19:44:34.556464 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556422    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 19:44:34.556632 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556498    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 19:44:34.556709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556695    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 19:44:34.556754 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556706    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 19:44:34.556838 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.556823    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 19:44:34.557104 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.557089    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nxh8n\""
May 28 19:44:34.561292 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.561271    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:44:34.648761 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.648761 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.648999 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.648999 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.648999 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.648999 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.648963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtd8l\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.649397 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.649211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.749967 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.749940    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.749976    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750011    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750038    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750075    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtd8l\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750099    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750126    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750157    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750205    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750236    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750266    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750293    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750752 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.750582    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.750752 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.750706    2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 28 19:44:34.750867 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:34.750768    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls podName:dbff52b4-88e8-4b48-837a-dace2574a02c nodeName:}" failed. No retries permitted until 2026-05-28 19:44:35.250747349 +0000 UTC m=+56.856311776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c") : secret "alertmanager-main-tls" not found
May 28 19:44:34.751268 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.751194    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.751268 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.751224    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.752968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.752921    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.753926 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.753882    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.754188 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.754170    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.754343 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.754324    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.754846 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.754826    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.755383 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.755343    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.755383 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.755355    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.755606 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.755589    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:34.760753 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:34.760730    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtd8l\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:35.154404 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.154355    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:35.154578 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.154560    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:35.157124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.157096    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d0441e7-9dff-424a-9d67-8531795090ef-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ndkzz\" (UID: \"3d0441e7-9dff-424a-9d67-8531795090ef\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:35.157574 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.157547    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c189b147-1c12-44dd-baa4-5c5ff4f1aea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-49klv\" (UID: \"c189b147-1c12-44dd-baa4-5c5ff4f1aea1\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:35.255483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.255456    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:35.258215 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.258192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:35.293295 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.293268    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv"
May 28 19:44:35.307853 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.307819    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"
May 28 19:44:35.310058 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.310029    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggtpt" event={"ID":"7b19a241-0516-4342-a24d-49aee3d367a6","Type":"ContainerStarted","Data":"595406a0c91a5bf3b3cd71e263294a513ec8fff3ccf169316b3a631c476cdd59"}
May 28 19:44:35.310189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.310074    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggtpt" event={"ID":"7b19a241-0516-4342-a24d-49aee3d367a6","Type":"ContainerStarted","Data":"bec4f46f0e175b99f40a34798f4e8110e79e85ed7116721ecb0cf9254d96766f"}
May 28 19:44:35.311581 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.311560    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db9b54d49-qkjtc" event={"ID":"2cad5295-0347-496e-acd0-cc68b9fd05b1","Type":"ContainerStarted","Data":"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"}
May 28 19:44:35.344428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.344378    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7db9b54d49-qkjtc" podStartSLOduration=1.385374351 podStartE2EDuration="5.344364073s" podCreationTimestamp="2026-05-28 19:44:30 +0000 UTC" firstStartedPulling="2026-05-28 19:44:30.746299578 +0000 UTC m=+52.351863990" lastFinishedPulling="2026-05-28 19:44:34.705289302 +0000 UTC m=+56.310853712" observedRunningTime="2026-05-28 19:44:35.343454846 +0000 UTC m=+56.949019275" watchObservedRunningTime="2026-05-28 19:44:35.344364073 +0000 UTC m=+56.949928503"
May 28 19:44:35.441503 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.441470    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-49klv"]
May 28 19:44:35.455788 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.455761    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:44:35.461370 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.461344    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz"]
May 28 19:44:35.474891 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:35.474855    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc189b147_1c12_44dd_baa4_5c5ff4f1aea1.slice/crio-e9e91156e8362db459b5aeeb67c3bd8d11608398d23137ea40417149a2b43dc1 WatchSource:0}: Error finding container e9e91156e8362db459b5aeeb67c3bd8d11608398d23137ea40417149a2b43dc1: Status 404 returned error can't find the container with id e9e91156e8362db459b5aeeb67c3bd8d11608398d23137ea40417149a2b43dc1
May 28 19:44:35.475193 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:35.475168    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0441e7_9dff_424a_9d67_8531795090ef.slice/crio-0259ebd205640ba16f2cd75440eae40addcbf7c4eb5a7082e118ea1a3e86d945 WatchSource:0}: Error finding container 0259ebd205640ba16f2cd75440eae40addcbf7c4eb5a7082e118ea1a3e86d945: Status 404 returned error can't find the container with id 0259ebd205640ba16f2cd75440eae40addcbf7c4eb5a7082e118ea1a3e86d945
May 28 19:44:35.552852 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.551049    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"]
May 28 19:44:35.555771 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.555730    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.559813 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.559165    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 19:44:35.559813 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.559420    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 19:44:35.561428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.560612    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-el6bsrj6k419j\""
May 28 19:44:35.561428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.560738    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gdxsr\""
May 28 19:44:35.561428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.560863    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 19:44:35.561428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.561162    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 19:44:35.561669 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.561451    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"]
May 28 19:44:35.562471 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.561851    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 19:44:35.600236 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.600210    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:44:35.602986 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:35.602954    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbff52b4_88e8_4b48_837a_dace2574a02c.slice/crio-d1779d6b0200b1b04d145f0c70162d205a28fb169040c4760d4877eb9af4f919 WatchSource:0}: Error finding container d1779d6b0200b1b04d145f0c70162d205a28fb169040c4760d4877eb9af4f919: Status 404 returned error can't find the container with id d1779d6b0200b1b04d145f0c70162d205a28fb169040c4760d4877eb9af4f919
May 28 19:44:35.663530 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663530 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663530 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqnt\" (UniqueName: \"kubernetes.io/projected/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-kube-api-access-mkqnt\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-metrics-client-ca\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-grpc-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.663861 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.663818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.764914 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.764873    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765072 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.764922    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765072 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.764987    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765072 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765016    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqnt\" (UniqueName: \"kubernetes.io/projected/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-kube-api-access-mkqnt\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765072 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765037    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-metrics-client-ca\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765072 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765055    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765307 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765084    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765307 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765105    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-grpc-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.765849 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.765787    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-metrics-client-ca\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.767580 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.767511    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.767806 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.767770    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-grpc-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.767870 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.767777    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.767997 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.767974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.768066 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.768044    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-tls\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.768562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.768540    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.773236 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.773210    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqnt\" (UniqueName: \"kubernetes.io/projected/c9c876c1-69f2-4fe7-8291-fbe3849c1ebc-kube-api-access-mkqnt\") pod \"thanos-querier-7b77b6746d-5ztwc\" (UID: \"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc\") " pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:35.869648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:35.869613    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:36.205645 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.205588    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"]
May 28 19:44:36.209435 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:36.209393    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c876c1_69f2_4fe7_8291_fbe3849c1ebc.slice/crio-42f0a8ab6934a1c5f9b2022ec4aba37106d3fdac2b498ab68c859bd21811da0d WatchSource:0}: Error finding container 42f0a8ab6934a1c5f9b2022ec4aba37106d3fdac2b498ab68c859bd21811da0d: Status 404 returned error can't find the container with id 42f0a8ab6934a1c5f9b2022ec4aba37106d3fdac2b498ab68c859bd21811da0d
May 28 19:44:36.316773 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.316705    2564 generic.go:358] "Generic (PLEG): container finished" podID="7b19a241-0516-4342-a24d-49aee3d367a6" containerID="595406a0c91a5bf3b3cd71e263294a513ec8fff3ccf169316b3a631c476cdd59" exitCode=0
May 28 19:44:36.316973 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.316812    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggtpt" event={"ID":"7b19a241-0516-4342-a24d-49aee3d367a6","Type":"ContainerDied","Data":"595406a0c91a5bf3b3cd71e263294a513ec8fff3ccf169316b3a631c476cdd59"}
May 28 19:44:36.319390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.319339    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"d1779d6b0200b1b04d145f0c70162d205a28fb169040c4760d4877eb9af4f919"}
May 28 19:44:36.322256 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.322229    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz" event={"ID":"3d0441e7-9dff-424a-9d67-8531795090ef","Type":"ContainerStarted","Data":"0259ebd205640ba16f2cd75440eae40addcbf7c4eb5a7082e118ea1a3e86d945"}
May 28 19:44:36.323847 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.323827    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"42f0a8ab6934a1c5f9b2022ec4aba37106d3fdac2b498ab68c859bd21811da0d"}
May 28 19:44:36.327369 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.327024    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv" event={"ID":"c189b147-1c12-44dd-baa4-5c5ff4f1aea1","Type":"ContainerStarted","Data":"cfdb57dcabec14a4b71c4ede726345156bdb78be8b57c947ad629cb24c2c2204"}
May 28 19:44:36.327369 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.327064    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv" event={"ID":"c189b147-1c12-44dd-baa4-5c5ff4f1aea1","Type":"ContainerStarted","Data":"0eda04fe879a5fb8bfd0ccfa1f014fa7353fcc2e04df190fa10c7a925de04733"}
May 28 19:44:36.327369 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:36.327078    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv" event={"ID":"c189b147-1c12-44dd-baa4-5c5ff4f1aea1","Type":"ContainerStarted","Data":"e9e91156e8362db459b5aeeb67c3bd8d11608398d23137ea40417149a2b43dc1"}
May 28 19:44:37.332513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:37.332470    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggtpt" event={"ID":"7b19a241-0516-4342-a24d-49aee3d367a6","Type":"ContainerStarted","Data":"2fa6ec659568151444d9495159b4a8a3d2d25b97f565867c3889f6d342c8d4af"}
May 28 19:44:37.332513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:37.332514    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggtpt" event={"ID":"7b19a241-0516-4342-a24d-49aee3d367a6","Type":"ContainerStarted","Data":"aa2ac7c38f3d59be4de5c8d830eb3d2d5dfdd0881345efeb50ce659a8db43e8e"}
May 28 19:44:37.354845 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:37.354773    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ggtpt" podStartSLOduration=3.462427324 podStartE2EDuration="4.354757587s" podCreationTimestamp="2026-05-28 19:44:33 +0000 UTC" firstStartedPulling="2026-05-28 19:44:34.34734761 +0000 UTC m=+55.952912017" lastFinishedPulling="2026-05-28 19:44:35.239677868 +0000 UTC m=+56.845242280" observedRunningTime="2026-05-28 19:44:37.353469641 +0000 UTC m=+58.959034086" watchObservedRunningTime="2026-05-28 19:44:37.354757587 +0000 UTC m=+58.960322016"
May 28 19:44:38.338846 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.338761    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv" event={"ID":"c189b147-1c12-44dd-baa4-5c5ff4f1aea1","Type":"ContainerStarted","Data":"44743a9b0661529d672c3623a039e30cd056723c2fbce3c666cf505b5d94ad30"}
May 28 19:44:38.340531 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.340506    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0" exitCode=0
May 28 19:44:38.340676 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.340584    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"}
May 28 19:44:38.342873 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.342839    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz" event={"ID":"3d0441e7-9dff-424a-9d67-8531795090ef","Type":"ContainerStarted","Data":"4b89ee028afd7f555eb9c162552285f3ec6f540521a25e07c19d404a6f818804"}
May 28 19:44:38.342873 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.342872    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz" event={"ID":"3d0441e7-9dff-424a-9d67-8531795090ef","Type":"ContainerStarted","Data":"6b2ca5c5fce9c33cb79dcfe298791133fdd34c36378eb18e58331bd459d17abb"}
May 28 19:44:38.343101 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.342886    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz" event={"ID":"3d0441e7-9dff-424a-9d67-8531795090ef","Type":"ContainerStarted","Data":"e8921989a1ed97f0fb2526011e5b4cf144ba6e9f12705e9620b9a298b8e009bd"}
May 28 19:44:38.358322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.358260    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-49klv" podStartSLOduration=3.60649475 podStartE2EDuration="5.358241996s" podCreationTimestamp="2026-05-28 19:44:33 +0000 UTC" firstStartedPulling="2026-05-28 19:44:35.617259998 +0000 UTC m=+57.222824406" lastFinishedPulling="2026-05-28 19:44:37.36900724 +0000 UTC m=+58.974571652" observedRunningTime="2026-05-28 19:44:38.357577572 +0000 UTC m=+59.963142001" watchObservedRunningTime="2026-05-28 19:44:38.358241996 +0000 UTC m=+59.963806427"
May 28 19:44:38.379359 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.379296    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ndkzz" podStartSLOduration=3.484236238 podStartE2EDuration="5.379274887s" podCreationTimestamp="2026-05-28 19:44:33 +0000 UTC" firstStartedPulling="2026-05-28 19:44:35.477038456 +0000 UTC m=+57.082602867" lastFinishedPulling="2026-05-28 19:44:37.372077096 +0000 UTC m=+58.977641516" observedRunningTime="2026-05-28 19:44:38.377489942 +0000 UTC m=+59.983054372" watchObservedRunningTime="2026-05-28 19:44:38.379274887 +0000 UTC m=+59.984839320"
May 28 19:44:38.677234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.677198    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-756dc5758b-grmnp"]
May 28 19:44:38.680560 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.680543    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.683089 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683054    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 19:44:38.683089 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683083    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 19:44:38.683264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683081    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 19:44:38.683264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683152    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 19:44:38.683264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683168    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-52swg\""
May 28 19:44:38.683434 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.683417    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 19:44:38.688007 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.687990    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 19:44:38.691696 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.691678    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756dc5758b-grmnp"]
May 28 19:44:38.791326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791537 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-metrics-client-ca\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791537 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791537 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-federate-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791537 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-serving-certs-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791657 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkcfq\" (UniqueName: \"kubernetes.io/projected/1120374d-213b-4cbb-9da2-21b2af823de3-kube-api-access-nkcfq\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.791657 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.791629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892524 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892494    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkcfq\" (UniqueName: \"kubernetes.io/projected/1120374d-213b-4cbb-9da2-21b2af823de3-kube-api-access-nkcfq\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892556    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892627    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892661    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892684    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-metrics-client-ca\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892953 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892713    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892953 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892790    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-federate-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.892953 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.892884    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-serving-certs-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.893402 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.893382    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-metrics-client-ca\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.895020 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.894997    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 19:44:38.895020 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.895015    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 19:44:38.895215 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.895027    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 19:44:38.895215 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.895128    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 19:44:38.895390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.895371    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 19:44:38.903256 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.900717    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 19:44:38.904031 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.903953    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.904330 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.904307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkcfq\" (UniqueName: \"kubernetes.io/projected/1120374d-213b-4cbb-9da2-21b2af823de3-kube-api-access-nkcfq\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.904864 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.904839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1120374d-213b-4cbb-9da2-21b2af823de3-serving-certs-ca-bundle\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.906196 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.906168    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-federate-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.906287 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.906173    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.907407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.907381    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-telemeter-client-tls\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.907507 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.907482    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1120374d-213b-4cbb-9da2-21b2af823de3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756dc5758b-grmnp\" (UID: \"1120374d-213b-4cbb-9da2-21b2af823de3\") " pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:38.992482 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:38.992451    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-52swg\""
May 28 19:44:39.000737 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.000716    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp"
May 28 19:44:39.154137 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.154052    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756dc5758b-grmnp"]
May 28 19:44:39.157954 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:39.157920    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1120374d_213b_4cbb_9da2_21b2af823de3.slice/crio-7427f1ba997d5f85cf58800c2cadd4630f47f3a26d92fa8273eea94ac515e6d9 WatchSource:0}: Error finding container 7427f1ba997d5f85cf58800c2cadd4630f47f3a26d92fa8273eea94ac515e6d9: Status 404 returned error can't find the container with id 7427f1ba997d5f85cf58800c2cadd4630f47f3a26d92fa8273eea94ac515e6d9
May 28 19:44:39.237437 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.237397    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8gl6"
May 28 19:44:39.347197 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.347136    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp" event={"ID":"1120374d-213b-4cbb-9da2-21b2af823de3","Type":"ContainerStarted","Data":"7427f1ba997d5f85cf58800c2cadd4630f47f3a26d92fa8273eea94ac515e6d9"}
May 28 19:44:39.349289 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.349237    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"266458b77082a4ed13042dc155ab6714b4defbeed1cff00fa73f80bd8723f3ab"}
May 28 19:44:39.349289 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.349275    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"d0bfa2669521e95d812157deb443a6a8815b41c012bee5042b6b8740434f4335"}
May 28 19:44:39.349470 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.349300    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"a775f556413d16f2f5cbd8227ae22c9a7cac9e7be1b6aac2ab7cf18713087573"}
May 28 19:44:39.689370 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.689335    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:44:39.694210 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.694181    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.697124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.696903    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 19:44:39.697124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.696930    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 19:44:39.697124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.696954    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 19:44:39.697124 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.696966    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 19:44:39.697438 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.697206    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 19:44:39.697923 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.697642    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 19:44:39.697923 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.697690    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7tramuldddfam\""
May 28 19:44:39.697923 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.697701    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 19:44:39.698977 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.698184    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 19:44:39.698977 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.698285    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9t82g\""
May 28 19:44:39.698977 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.698286    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 19:44:39.698977 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.698423    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 19:44:39.698977 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.698841    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 19:44:39.699267 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.699068    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 19:44:39.704461 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.704347    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 19:44:39.709738 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.709669    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:44:39.800567 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.800760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.800760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7wh\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.800760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.800760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.800760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.800995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.801031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.801056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.801079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.801126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.801483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.801146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.901885 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.901844    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902053 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.901896    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902053 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.901959    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902053 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.901986    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902053 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902043    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902070    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902103    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7wh\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902137    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902195    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902239    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902298 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902265    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902301    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902325    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902350    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902376    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902401    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902424    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.902547 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.902467    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.903279 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.903249    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.904160 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.904130    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.905498 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.905467    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.907399 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.906724    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.908032 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.908008    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.908414 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.908385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.908876 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.908851    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.909389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.909077    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.909487 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.909468    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.912860 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.912596    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.913667 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.913586    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.913667 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.913651    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.913983 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.913961    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.914251 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.914225    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.914673 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.914652    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.915214 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.915177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.915214 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.915198    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:39.916504 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:39.916465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7wh\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh\") pod \"prometheus-k8s-0\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:40.008526 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.008498    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:40.191320 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.191260    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:44:40.353375 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.353343    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7" exitCode=0
May 28 19:44:40.353678 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.353395    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"}
May 28 19:44:40.353678 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.353430    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"60392718bc609d6aaee13722982e8436fa51a4b123add908f95f84493e3e6c00"}
May 28 19:44:40.356632 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.356572    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"31029bc5f51d46428f80190bd93d29e38477d05b448e8f010a9584684b432576"}
May 28 19:44:40.356632 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.356606    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"c85d9b61f080a1292b3d0e03e84512bf7374e5c25e70a6e2a8d79ac36395c684"}
May 28 19:44:40.356632 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.356615    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" event={"ID":"c9c876c1-69f2-4fe7-8291-fbe3849c1ebc","Type":"ContainerStarted","Data":"c78a40cbddad6203a4a84c83d014af1b0f00d2ced0fd2afdd1d87df043c0e2f7"}
May 28 19:44:40.357050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.357031    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:40.360647 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.360626    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"}
May 28 19:44:40.360723 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.360657    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"}
May 28 19:44:40.360723 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.360670    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"}
May 28 19:44:40.399623 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.399568    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc" podStartSLOduration=1.6957150859999999 podStartE2EDuration="5.399547872s" podCreationTimestamp="2026-05-28 19:44:35 +0000 UTC" firstStartedPulling="2026-05-28 19:44:36.212182053 +0000 UTC m=+57.817746464" lastFinishedPulling="2026-05-28 19:44:39.916014839 +0000 UTC m=+61.521579250" observedRunningTime="2026-05-28 19:44:40.397735606 +0000 UTC m=+62.003300065" watchObservedRunningTime="2026-05-28 19:44:40.399547872 +0000 UTC m=+62.005112304"
May 28 19:44:40.459939 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.459915    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:44:40.464474 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.464446    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.473376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.473096    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 19:44:40.475337 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.475307    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:44:40.599209 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.599137    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:40.599209 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.599190    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:40.605674 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.605646    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:40.611961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.611828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.611961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.611888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.611961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.611913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.612234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.612010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzxm\" (UniqueName: \"kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.612234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.612054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.612234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.612118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.612234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.612147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.712991 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.712898    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.712991 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.712951    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.712991 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.712976    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.713264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.713021    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzxm\" (UniqueName: \"kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.713264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.713069    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.713264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.713158    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.713264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.713188    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.714343 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.714279    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.714469 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.714399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.714654 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.714629    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.719101 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.716204    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.719101 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.717545    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.720254 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.720232    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.722247 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.722221    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzxm\" (UniqueName: \"kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm\") pod \"console-84ff5b547f-246gf\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") " pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.777337 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.777290    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:40.904409 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:40.904383    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:44:40.906657 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:40.906628    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2955996c_2616_43ab_b59a_85c8ab313d24.slice/crio-807d78ef37063ffebb87b48caf47cd67f79143fb9d30058fcf516f3b69784b65 WatchSource:0}: Error finding container 807d78ef37063ffebb87b48caf47cd67f79143fb9d30058fcf516f3b69784b65: Status 404 returned error can't find the container with id 807d78ef37063ffebb87b48caf47cd67f79143fb9d30058fcf516f3b69784b65
May 28 19:44:41.299279 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.299194    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t48tq"
May 28 19:44:41.370375 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.370334    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"}
May 28 19:44:41.370894 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.370384    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"}
May 28 19:44:41.370894 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.370401    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerStarted","Data":"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"}
May 28 19:44:41.372345 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.372321    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ff5b547f-246gf" event={"ID":"2955996c-2616-43ab-b59a-85c8ab313d24","Type":"ContainerStarted","Data":"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"}
May 28 19:44:41.372463 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.372374    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ff5b547f-246gf" event={"ID":"2955996c-2616-43ab-b59a-85c8ab313d24","Type":"ContainerStarted","Data":"807d78ef37063ffebb87b48caf47cd67f79143fb9d30058fcf516f3b69784b65"}
May 28 19:44:41.378453 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.378429    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:44:41.399483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.399434    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.026537972 podStartE2EDuration="7.39941854s" podCreationTimestamp="2026-05-28 19:44:34 +0000 UTC" firstStartedPulling="2026-05-28 19:44:35.604887091 +0000 UTC m=+57.210451498" lastFinishedPulling="2026-05-28 19:44:39.977767656 +0000 UTC m=+61.583332066" observedRunningTime="2026-05-28 19:44:41.396875044 +0000 UTC m=+63.002439476" watchObservedRunningTime="2026-05-28 19:44:41.39941854 +0000 UTC m=+63.004982970"
May 28 19:44:41.442931 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:41.442843    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84ff5b547f-246gf" podStartSLOduration=1.442789336 podStartE2EDuration="1.442789336s" podCreationTimestamp="2026-05-28 19:44:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:44:41.441723447 +0000 UTC m=+63.047287877" watchObservedRunningTime="2026-05-28 19:44:41.442789336 +0000 UTC m=+63.048353769"
May 28 19:44:42.377516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:42.377469    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp" event={"ID":"1120374d-213b-4cbb-9da2-21b2af823de3","Type":"ContainerStarted","Data":"23fdc4427ea4802b07f0aaa4af3375b45c9e95adf6b55035b83ef2251216937d"}
May 28 19:44:42.377516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:42.377515    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp" event={"ID":"1120374d-213b-4cbb-9da2-21b2af823de3","Type":"ContainerStarted","Data":"b0d84596d6e16120360ac347634b562b3ce88cdc7aed60f07b98bec7ec37c8b0"}
May 28 19:44:42.378022 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:42.377533    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp" event={"ID":"1120374d-213b-4cbb-9da2-21b2af823de3","Type":"ContainerStarted","Data":"2847c3802044b62ce5199bf0153707f93447ca3dd40f420e80cf09873d30054c"}
May 28 19:44:42.421573 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:42.421513    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-756dc5758b-grmnp" podStartSLOduration=1.89813564 podStartE2EDuration="4.421492835s" podCreationTimestamp="2026-05-28 19:44:38 +0000 UTC" firstStartedPulling="2026-05-28 19:44:39.161234914 +0000 UTC m=+60.766799333" lastFinishedPulling="2026-05-28 19:44:41.684592107 +0000 UTC m=+63.290156528" observedRunningTime="2026-05-28 19:44:42.420111034 +0000 UTC m=+64.025675468" watchObservedRunningTime="2026-05-28 19:44:42.421492835 +0000 UTC m=+64.027057269"
May 28 19:44:43.382827 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.382780    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"}
May 28 19:44:43.383245 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.382832    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"}
May 28 19:44:43.584133 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.584105    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:44:43.614201 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.614173    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:44:43.617509 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.617488    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.628726 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.628701    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:44:43.753746 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.753746 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.753746 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.754013 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jxd\" (UniqueName: \"kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.754013 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.754013 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.754013 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.753952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855335 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855286    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855510 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855348    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27jxd\" (UniqueName: \"kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855510 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855384    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855510 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855467    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855664 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855599    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855726 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855703    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.855778 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.855726    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.856380 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.856357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.856432 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.856386    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.856463 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.856446    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.856498 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.856474    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.858051 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.858021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.858141 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.858021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.862773 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.862750    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jxd\" (UniqueName: \"kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd\") pod \"console-5797c76646-j5lpd\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") " pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:43.927025 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:43.926980    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:44.051247 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.051175    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:44:44.054350 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:44.054322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acbf757_7897_4e0c_b895_68000b24b6a0.slice/crio-880497cc06b8de55b148afc79349011954de2fdbd23ccbbdd0ce3b08dac4a6eb WatchSource:0}: Error finding container 880497cc06b8de55b148afc79349011954de2fdbd23ccbbdd0ce3b08dac4a6eb: Status 404 returned error can't find the container with id 880497cc06b8de55b148afc79349011954de2fdbd23ccbbdd0ce3b08dac4a6eb
May 28 19:44:44.386733 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.386638    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5797c76646-j5lpd" event={"ID":"0acbf757-7897-4e0c-b895-68000b24b6a0","Type":"ContainerStarted","Data":"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"}
May 28 19:44:44.386733 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.386683    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5797c76646-j5lpd" event={"ID":"0acbf757-7897-4e0c-b895-68000b24b6a0","Type":"ContainerStarted","Data":"880497cc06b8de55b148afc79349011954de2fdbd23ccbbdd0ce3b08dac4a6eb"}
May 28 19:44:44.389620 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.389548    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"}
May 28 19:44:44.389620 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.389616    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"}
May 28 19:44:44.389766 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.389626    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"}
May 28 19:44:44.389766 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.389664    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerStarted","Data":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"}
May 28 19:44:44.406108 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.406061    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5797c76646-j5lpd" podStartSLOduration=1.406047987 podStartE2EDuration="1.406047987s" podCreationTimestamp="2026-05-28 19:44:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:44:44.40458165 +0000 UTC m=+66.010146101" watchObservedRunningTime="2026-05-28 19:44:44.406047987 +0000 UTC m=+66.011612411"
May 28 19:44:44.431559 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.431476    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.563884807 podStartE2EDuration="5.431462131s" podCreationTimestamp="2026-05-28 19:44:39 +0000 UTC" firstStartedPulling="2026-05-28 19:44:40.355426032 +0000 UTC m=+61.960990441" lastFinishedPulling="2026-05-28 19:44:43.223003346 +0000 UTC m=+64.828567765" observedRunningTime="2026-05-28 19:44:44.429002992 +0000 UTC m=+66.034567456" watchObservedRunningTime="2026-05-28 19:44:44.431462131 +0000 UTC m=+66.037026560"
May 28 19:44:44.562361 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:44.562327    2564 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: configmap "prometheus-k8s-rulefiles-0" not found
May 28 19:44:44.562564 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:44:44.562479    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0 podName:a6cc8969-e517-4001-85d7-5ee7a28e8e97 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:45.062454066 +0000 UTC m=+66.668018491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97") : configmap "prometheus-k8s-rulefiles-0" not found
May 28 19:44:44.663947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.663901    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:44.664132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.663973    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:44.666902 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.666880    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 19:44:44.667037 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.666886    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 19:44:44.676954 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.676920    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 19:44:44.677510 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.677485    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13055ac8-d738-4e60-80d2-c2774a5dafd4-metrics-certs\") pod \"network-metrics-daemon-h5fjp\" (UID: \"13055ac8-d738-4e60-80d2-c2774a5dafd4\") " pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:44.688120 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.688098    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfp2\" (UniqueName: \"kubernetes.io/projected/4b732133-b5a5-4092-8aaf-8a90b7bcd410-kube-api-access-znfp2\") pod \"network-check-target-mpkxr\" (UID: \"4b732133-b5a5-4092-8aaf-8a90b7bcd410\") " pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:44.758299 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.758268    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-msmgn\""
May 28 19:44:44.766359 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.766328    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5fjp"
May 28 19:44:44.863518 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.863491    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-622pq\""
May 28 19:44:44.871550 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.871525    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:44.887417 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.887395    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5fjp"]
May 28 19:44:44.889669 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:44.889644    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13055ac8_d738_4e60_80d2_c2774a5dafd4.slice/crio-fc067f0a8071258bd323b0ae83020571bc55632cc0f8667486e66531325711ab WatchSource:0}: Error finding container fc067f0a8071258bd323b0ae83020571bc55632cc0f8667486e66531325711ab: Status 404 returned error can't find the container with id fc067f0a8071258bd323b0ae83020571bc55632cc0f8667486e66531325711ab
May 28 19:44:44.995328 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:44.995304    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpkxr"]
May 28 19:44:44.997981 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:44:44.997941    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b732133_b5a5_4092_8aaf_8a90b7bcd410.slice/crio-0d3d7aab1c103ffbe75f49c29736d2b6cb7bdcfce382b37c2166cfb2c66d2f2f WatchSource:0}: Error finding container 0d3d7aab1c103ffbe75f49c29736d2b6cb7bdcfce382b37c2166cfb2c66d2f2f: Status 404 returned error can't find the container with id 0d3d7aab1c103ffbe75f49c29736d2b6cb7bdcfce382b37c2166cfb2c66d2f2f
May 28 19:44:45.009303 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:45.009279    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:44:45.395464 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:45.395425    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpkxr" event={"ID":"4b732133-b5a5-4092-8aaf-8a90b7bcd410","Type":"ContainerStarted","Data":"0d3d7aab1c103ffbe75f49c29736d2b6cb7bdcfce382b37c2166cfb2c66d2f2f"}
May 28 19:44:45.396755 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:45.396720    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5fjp" event={"ID":"13055ac8-d738-4e60-80d2-c2774a5dafd4","Type":"ContainerStarted","Data":"fc067f0a8071258bd323b0ae83020571bc55632cc0f8667486e66531325711ab"}
May 28 19:44:46.380441 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:46.380409    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b77b6746d-5ztwc"
May 28 19:44:47.407336 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:47.406553    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5fjp" event={"ID":"13055ac8-d738-4e60-80d2-c2774a5dafd4","Type":"ContainerStarted","Data":"45fdade6bb8c8b63dafd97bfe7d1e35a4374a98f9d60618314f504a7ea2eefee"}
May 28 19:44:47.407336 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:47.406600    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5fjp" event={"ID":"13055ac8-d738-4e60-80d2-c2774a5dafd4","Type":"ContainerStarted","Data":"1635391622b2ac9e0f91486fc4e30b6cfc2da6d3bad7cddd1bb51eab840a0e1a"}
May 28 19:44:47.424365 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:47.424314    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h5fjp" podStartSLOduration=66.905927171 podStartE2EDuration="1m8.42430077s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:44:44.891525639 +0000 UTC m=+66.497090048" lastFinishedPulling="2026-05-28 19:44:46.409899221 +0000 UTC m=+68.015463647" observedRunningTime="2026-05-28 19:44:47.423344856 +0000 UTC m=+69.028909282" watchObservedRunningTime="2026-05-28 19:44:47.42430077 +0000 UTC m=+69.029865199"
May 28 19:44:49.418287 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:49.418252    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpkxr" event={"ID":"4b732133-b5a5-4092-8aaf-8a90b7bcd410","Type":"ContainerStarted","Data":"7e09280d86b73018c57053abc7032fef1723ae96088e8cf1c5766a6fa67719ce"}
May 28 19:44:49.418667 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:49.418352    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:44:49.436274 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:49.436079    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mpkxr" podStartSLOduration=66.705650788 podStartE2EDuration="1m10.436054522s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:44:44.999844918 +0000 UTC m=+66.605409329" lastFinishedPulling="2026-05-28 19:44:48.730248637 +0000 UTC m=+70.335813063" observedRunningTime="2026-05-28 19:44:49.435219085 +0000 UTC m=+71.040783514" watchObservedRunningTime="2026-05-28 19:44:49.436054522 +0000 UTC m=+71.041618954"
May 28 19:44:50.777614 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:50.777579    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:44:53.927968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:53.927850    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:53.927968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:53.927888    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:53.932467 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:53.932449    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:54.437203 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:54.437176    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:44:54.490033 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:44:54.490004    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:45:08.603288 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.603215    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84ff5b547f-246gf" podUID="2955996c-2616-43ab-b59a-85c8ab313d24" containerName="console" containerID="cri-o://2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c" gracePeriod=15
May 28 19:45:08.844369 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.844345    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84ff5b547f-246gf_2955996c-2616-43ab-b59a-85c8ab313d24/console/0.log"
May 28 19:45:08.844505 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.844418    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:45:08.870336 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870251    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870336 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870310    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870544 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870352    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870544 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870385    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870544 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870419    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870544 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870458    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdzxm\" (UniqueName: \"kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870544 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870488    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config\") pod \"2955996c-2616-43ab-b59a-85c8ab313d24\" (UID: \"2955996c-2616-43ab-b59a-85c8ab313d24\") "
May 28 19:45:08.870842 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870787    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:08.870940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870818    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:08.870982 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.870862    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca" (OuterVolumeSpecName: "service-ca") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:08.871060 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.871035    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config" (OuterVolumeSpecName: "console-config") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:08.872578 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.872553    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:08.872578 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.872565    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:08.872711 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.872679    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm" (OuterVolumeSpecName: "kube-api-access-gdzxm") pod "2955996c-2616-43ab-b59a-85c8ab313d24" (UID: "2955996c-2616-43ab-b59a-85c8ab313d24"). InnerVolumeSpecName "kube-api-access-gdzxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:08.971687 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971652    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-oauth-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971687 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971680    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-trusted-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971687 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971690    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2955996c-2616-43ab-b59a-85c8ab313d24-console-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971687 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971699    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-oauth-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971975 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971708    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-service-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971975 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971719    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdzxm\" (UniqueName: \"kubernetes.io/projected/2955996c-2616-43ab-b59a-85c8ab313d24-kube-api-access-gdzxm\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:08.971975 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:08.971730    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2955996c-2616-43ab-b59a-85c8ab313d24-console-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:09.478472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84ff5b547f-246gf_2955996c-2616-43ab-b59a-85c8ab313d24/console/0.log"
May 28 19:45:09.478655 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478483    2564 generic.go:358] "Generic (PLEG): container finished" podID="2955996c-2616-43ab-b59a-85c8ab313d24" containerID="2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c" exitCode=2
May 28 19:45:09.478655 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478546    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ff5b547f-246gf"
May 28 19:45:09.478655 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478547    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ff5b547f-246gf" event={"ID":"2955996c-2616-43ab-b59a-85c8ab313d24","Type":"ContainerDied","Data":"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"}
May 28 19:45:09.478842 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478667    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ff5b547f-246gf" event={"ID":"2955996c-2616-43ab-b59a-85c8ab313d24","Type":"ContainerDied","Data":"807d78ef37063ffebb87b48caf47cd67f79143fb9d30058fcf516f3b69784b65"}
May 28 19:45:09.478842 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.478701    2564 scope.go:117] "RemoveContainer" containerID="2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"
May 28 19:45:09.486982 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.486965    2564 scope.go:117] "RemoveContainer" containerID="2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"
May 28 19:45:09.487260 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:09.487238    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c\": container with ID starting with 2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c not found: ID does not exist" containerID="2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"
May 28 19:45:09.487304 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.487268    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c"} err="failed to get container status \"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c\": rpc error: code = NotFound desc = could not find container \"2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c\": container with ID starting with 2ed0edaf9eca1b47bf8ff6e5d63052883c0538a9a0c0ecd503d39418bdd1c21c not found: ID does not exist"
May 28 19:45:09.496407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.496381    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:45:09.502294 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:09.502273    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84ff5b547f-246gf"]
May 28 19:45:11.050611 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:11.050574    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2955996c-2616-43ab-b59a-85c8ab313d24" path="/var/lib/kubelet/pods/2955996c-2616-43ab-b59a-85c8ab313d24/volumes"
May 28 19:45:19.512523 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.512468    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7db9b54d49-qkjtc" podUID="2cad5295-0347-496e-acd0-cc68b9fd05b1" containerName="console" containerID="cri-o://416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7" gracePeriod=15
May 28 19:45:19.744764 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.744741    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7db9b54d49-qkjtc_2cad5295-0347-496e-acd0-cc68b9fd05b1/console/0.log"
May 28 19:45:19.744905 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.744825    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:45:19.873040 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.872940    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873040 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873005    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873265 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873070    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873265 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873091    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nw8x\" (UniqueName: \"kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873265 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873124    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873265 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873152    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config\") pod \"2cad5295-0347-496e-acd0-cc68b9fd05b1\" (UID: \"2cad5295-0347-496e-acd0-cc68b9fd05b1\") "
May 28 19:45:19.873491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873455    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:19.873550 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873463    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config" (OuterVolumeSpecName: "console-config") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:19.873594 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.873539    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:19.875264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.875238    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:19.875365 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.875346    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:19.875403 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.875362    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x" (OuterVolumeSpecName: "kube-api-access-4nw8x") pod "2cad5295-0347-496e-acd0-cc68b9fd05b1" (UID: "2cad5295-0347-496e-acd0-cc68b9fd05b1"). InnerVolumeSpecName "kube-api-access-4nw8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:19.974516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974469    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:19.974516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974512    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nw8x\" (UniqueName: \"kubernetes.io/projected/2cad5295-0347-496e-acd0-cc68b9fd05b1-kube-api-access-4nw8x\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:19.974516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974525    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-service-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:19.974516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974533    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-oauth-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:19.974789 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974542    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-oauth-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:19.974789 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:19.974551    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cad5295-0347-496e-acd0-cc68b9fd05b1-console-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:20.424414 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.424379    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mpkxr"
May 28 19:45:20.512928 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.512899    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7db9b54d49-qkjtc_2cad5295-0347-496e-acd0-cc68b9fd05b1/console/0.log"
May 28 19:45:20.513352 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.512943    2564 generic.go:358] "Generic (PLEG): container finished" podID="2cad5295-0347-496e-acd0-cc68b9fd05b1" containerID="416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7" exitCode=2
May 28 19:45:20.513352 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.513001    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db9b54d49-qkjtc"
May 28 19:45:20.513352 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.513029    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db9b54d49-qkjtc" event={"ID":"2cad5295-0347-496e-acd0-cc68b9fd05b1","Type":"ContainerDied","Data":"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"}
May 28 19:45:20.513352 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.513066    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db9b54d49-qkjtc" event={"ID":"2cad5295-0347-496e-acd0-cc68b9fd05b1","Type":"ContainerDied","Data":"e41fca68b93abc275551d415567401da13b007b892b53076e032d70afc678393"}
May 28 19:45:20.513352 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.513082    2564 scope.go:117] "RemoveContainer" containerID="416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"
May 28 19:45:20.521720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.521694    2564 scope.go:117] "RemoveContainer" containerID="416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"
May 28 19:45:20.522027 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:20.522009    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7\": container with ID starting with 416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7 not found: ID does not exist" containerID="416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"
May 28 19:45:20.522091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.522036    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7"} err="failed to get container status \"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7\": rpc error: code = NotFound desc = could not find container \"416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7\": container with ID starting with 416d13da5e1ac2fe6fd3493b31db39588f6d313fb0c6899a865c9afc574732f7 not found: ID does not exist"
May 28 19:45:20.533981 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.533952    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:45:20.537902 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:20.537878    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db9b54d49-qkjtc"]
May 28 19:45:21.050891 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:21.050860    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cad5295-0347-496e-acd0-cc68b9fd05b1" path="/var/lib/kubelet/pods/2cad5295-0347-496e-acd0-cc68b9fd05b1/volumes"
May 28 19:45:40.009616 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:40.009580    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:40.031209 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:40.031181    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:40.590428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:40.590401    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:53.876713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.876680    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:53.877377 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877316    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="alertmanager" containerID="cri-o://21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151" gracePeriod=120
May 28 19:45:53.877511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877346    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-metric" containerID="cri-o://02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a" gracePeriod=120
May 28 19:45:53.877511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877398    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-web" containerID="cri-o://3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05" gracePeriod=120
May 28 19:45:53.877511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877426    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="config-reloader" containerID="cri-o://a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df" gracePeriod=120
May 28 19:45:53.877511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877400    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="prom-label-proxy" containerID="cri-o://8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe" gracePeriod=120
May 28 19:45:53.877511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:53.877439    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy" containerID="cri-o://5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf" gracePeriod=120
May 28 19:45:54.616115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616077    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe" exitCode=0
May 28 19:45:54.616115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616108    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf" exitCode=0
May 28 19:45:54.616115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616118    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df" exitCode=0
May 28 19:45:54.616115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616126    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151" exitCode=0
May 28 19:45:54.616390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616155    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"}
May 28 19:45:54.616390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616191    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"}
May 28 19:45:54.616390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616202    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"}
May 28 19:45:54.616390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:54.616212    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"}
May 28 19:45:55.132515 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.132493    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188559    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188641    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188678    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188723    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188748    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtd8l\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188779    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188821    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188877    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188925    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.188978    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.189016    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.189059    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.189721 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.189084    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets\") pod \"dbff52b4-88e8-4b48-837a-dace2574a02c\" (UID: \"dbff52b4-88e8-4b48-837a-dace2574a02c\") "
May 28 19:45:55.192419 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.192109    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:45:55.194641 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.194164    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:55.196516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.196471    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:55.199229 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.199171    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:55.200472 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.200442    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.200630 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.200526    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.200785 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.200751    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.201008 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.200956    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.201008 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.200961    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l" (OuterVolumeSpecName: "kube-api-access-jtd8l") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "kube-api-access-jtd8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:55.201903 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.201691    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out" (OuterVolumeSpecName: "config-out") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:45:55.202000 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.201947    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.205250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.205226    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.210135 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.210107    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config" (OuterVolumeSpecName: "web-config") pod "dbff52b4-88e8-4b48-837a-dace2574a02c" (UID: "dbff52b4-88e8-4b48-837a-dace2574a02c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:55.290674 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290627    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-metrics-client-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290674 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290665    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-tls-assets\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290674 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290676    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290688    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290698    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290707    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-config-out\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290716    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtd8l\" (UniqueName: \"kubernetes.io/projected/dbff52b4-88e8-4b48-837a-dace2574a02c-kube-api-access-jtd8l\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290726    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-web-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290734    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-main-db\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290742    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290752    2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-cluster-tls-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290760    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbff52b4-88e8-4b48-837a-dace2574a02c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.290945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.290769    2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbff52b4-88e8-4b48-837a-dace2574a02c-config-volume\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:55.621783 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621687    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a" exitCode=0
May 28 19:45:55.621783 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621711    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerID="3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05" exitCode=0
May 28 19:45:55.621783 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621777    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"}
May 28 19:45:55.622080 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621831    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"}
May 28 19:45:55.622080 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621838    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.622080 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621857    2564 scope.go:117] "RemoveContainer" containerID="8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"
May 28 19:45:55.622080 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.621846    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbff52b4-88e8-4b48-837a-dace2574a02c","Type":"ContainerDied","Data":"d1779d6b0200b1b04d145f0c70162d205a28fb169040c4760d4877eb9af4f919"}
May 28 19:45:55.629314 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.629297    2564 scope.go:117] "RemoveContainer" containerID="02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"
May 28 19:45:55.639266 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.639093    2564 scope.go:117] "RemoveContainer" containerID="5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"
May 28 19:45:55.646442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.646418    2564 scope.go:117] "RemoveContainer" containerID="3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"
May 28 19:45:55.647908 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.647883    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:55.654030 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.654007    2564 scope.go:117] "RemoveContainer" containerID="a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"
May 28 19:45:55.655264 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.655242    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:55.662707 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.662689    2564 scope.go:117] "RemoveContainer" containerID="21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"
May 28 19:45:55.669425 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.669409    2564 scope.go:117] "RemoveContainer" containerID="c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"
May 28 19:45:55.676385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.676355    2564 scope.go:117] "RemoveContainer" containerID="8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"
May 28 19:45:55.676653 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.676634    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe\": container with ID starting with 8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe not found: ID does not exist" containerID="8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"
May 28 19:45:55.676713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.676661    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"} err="failed to get container status \"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe\": rpc error: code = NotFound desc = could not find container \"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe\": container with ID starting with 8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe not found: ID does not exist"
May 28 19:45:55.676713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.676681    2564 scope.go:117] "RemoveContainer" containerID="02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"
May 28 19:45:55.676925 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.676910    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a\": container with ID starting with 02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a not found: ID does not exist" containerID="02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"
May 28 19:45:55.676974 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.676929    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"} err="failed to get container status \"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a\": rpc error: code = NotFound desc = could not find container \"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a\": container with ID starting with 02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a not found: ID does not exist"
May 28 19:45:55.676974 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.676943    2564 scope.go:117] "RemoveContainer" containerID="5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"
May 28 19:45:55.677183 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.677163    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf\": container with ID starting with 5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf not found: ID does not exist" containerID="5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"
May 28 19:45:55.677224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677189    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"} err="failed to get container status \"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf\": rpc error: code = NotFound desc = could not find container \"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf\": container with ID starting with 5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf not found: ID does not exist"
May 28 19:45:55.677224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677207    2564 scope.go:117] "RemoveContainer" containerID="3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"
May 28 19:45:55.677401 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.677385    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05\": container with ID starting with 3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05 not found: ID does not exist" containerID="3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"
May 28 19:45:55.677442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677404    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"} err="failed to get container status \"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05\": rpc error: code = NotFound desc = could not find container \"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05\": container with ID starting with 3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05 not found: ID does not exist"
May 28 19:45:55.677442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677417    2564 scope.go:117] "RemoveContainer" containerID="a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"
May 28 19:45:55.677615 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.677599    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df\": container with ID starting with a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df not found: ID does not exist" containerID="a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"
May 28 19:45:55.677656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677620    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"} err="failed to get container status \"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df\": rpc error: code = NotFound desc = could not find container \"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df\": container with ID starting with a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df not found: ID does not exist"
May 28 19:45:55.677656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677632    2564 scope.go:117] "RemoveContainer" containerID="21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"
May 28 19:45:55.677900 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.677882    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151\": container with ID starting with 21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151 not found: ID does not exist" containerID="21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"
May 28 19:45:55.677964 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677912    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"} err="failed to get container status \"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151\": rpc error: code = NotFound desc = could not find container \"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151\": container with ID starting with 21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151 not found: ID does not exist"
May 28 19:45:55.677964 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.677927    2564 scope.go:117] "RemoveContainer" containerID="c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"
May 28 19:45:55.678140 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:55.678125    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0\": container with ID starting with c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0 not found: ID does not exist" containerID="c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"
May 28 19:45:55.678195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678144    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"} err="failed to get container status \"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0\": rpc error: code = NotFound desc = could not find container \"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0\": container with ID starting with c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0 not found: ID does not exist"
May 28 19:45:55.678195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678157    2564 scope.go:117] "RemoveContainer" containerID="8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"
May 28 19:45:55.678359 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678340    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe"} err="failed to get container status \"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe\": rpc error: code = NotFound desc = could not find container \"8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe\": container with ID starting with 8a756498f9d3605c77c67a7dd454bcf337fb1e42d86531dc989d4c51109673fe not found: ID does not exist"
May 28 19:45:55.678400 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678361    2564 scope.go:117] "RemoveContainer" containerID="02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"
May 28 19:45:55.678558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678543    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a"} err="failed to get container status \"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a\": rpc error: code = NotFound desc = could not find container \"02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a\": container with ID starting with 02fc3122db3a30c69efadabec365befdd2caec059e68b8e3901f40636fd5768a not found: ID does not exist"
May 28 19:45:55.678598 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678558    2564 scope.go:117] "RemoveContainer" containerID="5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"
May 28 19:45:55.678736 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678721    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf"} err="failed to get container status \"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf\": rpc error: code = NotFound desc = could not find container \"5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf\": container with ID starting with 5af8ae3f041e0d4a50e5338dabf1b3da21d3f729fc238370c2b8786df0be2eaf not found: ID does not exist"
May 28 19:45:55.678781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678736    2564 scope.go:117] "RemoveContainer" containerID="3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"
May 28 19:45:55.678940 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678920    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05"} err="failed to get container status \"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05\": rpc error: code = NotFound desc = could not find container \"3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05\": container with ID starting with 3db6e562c78357fc598bed9e9e95a57f6eb4562b8ba5327c9857ab8a8463ba05 not found: ID does not exist"
May 28 19:45:55.678982 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.678941    2564 scope.go:117] "RemoveContainer" containerID="a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"
May 28 19:45:55.679114 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.679099    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df"} err="failed to get container status \"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df\": rpc error: code = NotFound desc = could not find container \"a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df\": container with ID starting with a2bbd1812731faffde18b45089dd58c9d0e8509c202967bc80cbf5b4243a34df not found: ID does not exist"
May 28 19:45:55.679114 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.679113    2564 scope.go:117] "RemoveContainer" containerID="21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"
May 28 19:45:55.679312 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.679294    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151"} err="failed to get container status \"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151\": rpc error: code = NotFound desc = could not find container \"21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151\": container with ID starting with 21813916be019c7ba368d0592f314384014708df6044481441a3431e9e44d151 not found: ID does not exist"
May 28 19:45:55.679360 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.679313    2564 scope.go:117] "RemoveContainer" containerID="c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"
May 28 19:45:55.679521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.679504    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0"} err="failed to get container status \"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0\": rpc error: code = NotFound desc = could not find container \"c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0\": container with ID starting with c1fa4c1e7a8034f7396051fb96223350c0664afe353c4016e6a527b1621a47f0 not found: ID does not exist"
May 28 19:45:55.682703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.682684    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:55.683024 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683011    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cad5295-0347-496e-acd0-cc68b9fd05b1" containerName="console"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683026    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cad5295-0347-496e-acd0-cc68b9fd05b1" containerName="console"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683037    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="init-config-reloader"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683043    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="init-config-reloader"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683051    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="prom-label-proxy"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683057    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="prom-label-proxy"
May 28 19:45:55.683069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683067    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="alertmanager"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683072    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="alertmanager"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683079    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-metric"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683084    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-metric"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683090    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683095    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2955996c-2616-43ab-b59a-85c8ab313d24" containerName="console"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683105    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2955996c-2616-43ab-b59a-85c8ab313d24" containerName="console"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683116    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="config-reloader"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683120    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="config-reloader"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683128    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-web"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683134    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-web"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683177    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="alertmanager"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683185    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="prom-label-proxy"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683191    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cad5295-0347-496e-acd0-cc68b9fd05b1" containerName="console"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683198    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683204    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-metric"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683210    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="2955996c-2616-43ab-b59a-85c8ab313d24" containerName="console"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683217    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="kube-rbac-proxy-web"
May 28 19:45:55.683250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.683222    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" containerName="config-reloader"
May 28 19:45:55.688161 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.688144    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.690884 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.690865    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 19:45:55.690980 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.690905    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 19:45:55.691082 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691066    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 19:45:55.691176 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691160    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 19:45:55.691231 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691198    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 19:45:55.691282 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691265    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 19:45:55.691533 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691519    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 19:45:55.691595 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691530    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 19:45:55.691840 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.691820    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nxh8n\""
May 28 19:45:55.695738 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.695719    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 19:45:55.701083 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.701058    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:55.794126 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794327 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794327 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794327 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794327 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgcmp\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-kube-api-access-tgcmp\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-config-out\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-web-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794657 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794657 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-config-volume\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.794657 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.794541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895374 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895341    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-config-out\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895552 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895381    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-web-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895552 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895405    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895552 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895516    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895565    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-config-volume\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895589    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895638    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895668    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895721    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895763    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895835    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895874    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgcmp\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-kube-api-access-tgcmp\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.895942 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.895901    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.896187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.896049    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.896595 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.896566    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898333    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f52637a8-0a00-4f10-8e07-6821b8e29095-config-out\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898427    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898509    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898741 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898581    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-config-volume\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898741 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898651    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-web-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.898889 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.898752    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.899048 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.899028    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.899114 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.899030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f52637a8-0a00-4f10-8e07-6821b8e29095-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.899219 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.899197    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52637a8-0a00-4f10-8e07-6821b8e29095-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.900170 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.900155    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.907732 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.907716    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgcmp\" (UniqueName: \"kubernetes.io/projected/f52637a8-0a00-4f10-8e07-6821b8e29095-kube-api-access-tgcmp\") pod \"alertmanager-main-0\" (UID: \"f52637a8-0a00-4f10-8e07-6821b8e29095\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:55.998956 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:55.998917    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 19:45:56.131521 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:56.131468    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 19:45:56.134606 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:45:56.134579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52637a8_0a00_4f10_8e07_6821b8e29095.slice/crio-6156a084b5bf113d3ee0fcaaf0737989c0766263125c220f37be41e988ab557f WatchSource:0}: Error finding container 6156a084b5bf113d3ee0fcaaf0737989c0766263125c220f37be41e988ab557f: Status 404 returned error can't find the container with id 6156a084b5bf113d3ee0fcaaf0737989c0766263125c220f37be41e988ab557f
May 28 19:45:56.626571 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:56.626490    2564 generic.go:358] "Generic (PLEG): container finished" podID="f52637a8-0a00-4f10-8e07-6821b8e29095" containerID="da36b0ef8fa9393ba14f018f2b5550c9c476db450be9f8edb053aaf86837b2d2" exitCode=0
May 28 19:45:56.626571 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:56.626561    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerDied","Data":"da36b0ef8fa9393ba14f018f2b5550c9c476db450be9f8edb053aaf86837b2d2"}
May 28 19:45:56.626750 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:56.626582    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"6156a084b5bf113d3ee0fcaaf0737989c0766263125c220f37be41e988ab557f"}
May 28 19:45:57.051347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.051308    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbff52b4-88e8-4b48-837a-dace2574a02c" path="/var/lib/kubelet/pods/dbff52b4-88e8-4b48-837a-dace2574a02c/volumes"
May 28 19:45:57.632385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632352    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"bb8fd3f1d7fc62d320ea4d910194a571c7c0d400892bab72e6b68d23a71dcd6b"}
May 28 19:45:57.632758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632392    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"52df65f1cef5ece3f04d3ccdf7866ffbf596fae7b23daa82246cc711bc61ba95"}
May 28 19:45:57.632758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632405    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"78bea3fa8f0a738cbf21c4a6b4ece277ea1c26c22bd90bf0039a08644f962852"}
May 28 19:45:57.632758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632414    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"a9ee35798a8720b22e15b0d99c338e21ba204408e071370a1927a530fbb33c4b"}
May 28 19:45:57.632758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632422    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"25d66ee7d3647b5d990e0d4805063754f03bc9cf25785238b713e95210a0e51a"}
May 28 19:45:57.632758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.632430    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f52637a8-0a00-4f10-8e07-6821b8e29095","Type":"ContainerStarted","Data":"601d323f5ecc50c02b24c1bb7d174a6f1602584a805d6539d93c8e031f0e8d5f"}
May 28 19:45:57.660036 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:57.659894    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.659871231 podStartE2EDuration="2.659871231s" podCreationTimestamp="2026-05-28 19:45:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:45:57.658108991 +0000 UTC m=+139.263673418" watchObservedRunningTime="2026-05-28 19:45:57.659871231 +0000 UTC m=+139.265435666"
May 28 19:45:58.067107 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067076    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:58.067671 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067627    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy" containerID="cri-o://ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d" gracePeriod=600
May 28 19:45:58.067931 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067654    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="thanos-sidecar" containerID="cri-o://057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1" gracePeriod=600
May 28 19:45:58.068018 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067683    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="config-reloader" containerID="cri-o://e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e" gracePeriod=600
May 28 19:45:58.068089 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067660    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-web" containerID="cri-o://3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e" gracePeriod=600
May 28 19:45:58.068150 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067671    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="prometheus" containerID="cri-o://1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6" gracePeriod=600
May 28 19:45:58.068203 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.067713    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de" gracePeriod=600
May 28 19:45:58.325193 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.325169    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.419425 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419395    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419627 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419442    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419627 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419464    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7wh\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419627 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419489    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419702    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419751    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419821 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419780    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419845    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419882    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419913    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419925    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419949    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.419994 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.419976    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420036    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420070    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420117    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420150    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420183    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420198    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:58.420302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420210    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls\") pod \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\" (UID: \"a6cc8969-e517-4001-85d7-5ee7a28e8e97\") "
May 28 19:45:58.420648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420487    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.420648 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.420506    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-metrics-client-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.421939 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.421913    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.422082 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.422055    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh" (OuterVolumeSpecName: "kube-api-access-dr7wh") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "kube-api-access-dr7wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:58.422693 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.422669    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out" (OuterVolumeSpecName: "config-out") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:45:58.422897 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.422864    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.422997 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.422898    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.423088 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.423026    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.423151 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.423129    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.423238 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.423210    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:58.423321 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.423300    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:58.424262 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424235    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config" (OuterVolumeSpecName: "config") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.424376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424279    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:45:58.424376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424285    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.424376 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424343    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:45:58.424538 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424452    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:45:58.424720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.424697    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.434676 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.434649    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config" (OuterVolumeSpecName: "web-config") pod "a6cc8969-e517-4001-85d7-5ee7a28e8e97" (UID: "a6cc8969-e517-4001-85d7-5ee7a28e8e97"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:45:58.521069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521029    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-web-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521061    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521072    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-kube-rbac-proxy\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521082    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7wh\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-kube-api-access-dr7wh\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521092    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-grpc-tls\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521101    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521111    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521121    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6cc8969-e517-4001-85d7-5ee7a28e8e97-tls-assets\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521130    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521138    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-config-out\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521147    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521155    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521164    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6cc8969-e517-4001-85d7-5ee7a28e8e97-prometheus-k8s-db\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521174    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6cc8969-e517-4001-85d7-5ee7a28e8e97-secret-metrics-client-certs\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521182    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.521322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.521193    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cc8969-e517-4001-85d7-5ee7a28e8e97-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:45:58.639582 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639556    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de" exitCode=0
May 28 19:45:58.639582 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639581    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d" exitCode=0
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639587    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e" exitCode=0
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639593    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1" exitCode=0
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639599    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e" exitCode=0
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639604    2564 generic.go:358] "Generic (PLEG): container finished" podID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6" exitCode=0
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639642    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639671    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639692    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639727    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639743    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639758    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"}
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639766    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.640091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.639771    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6cc8969-e517-4001-85d7-5ee7a28e8e97","Type":"ContainerDied","Data":"60392718bc609d6aaee13722982e8436fa51a4b123add908f95f84493e3e6c00"}
May 28 19:45:58.647964 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.647944    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.654537 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.654519    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.660711 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.660689    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.664109 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.664085    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:58.668174 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.668155    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:58.668240 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.668215    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.674678 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.674661    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.681528 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.681510    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.688056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688038    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.688322 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.688304    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.688391 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688334    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.688391 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688362    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.688621 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.688601    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.688663 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688628    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.688663 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688647    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.688888 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.688868    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.688947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688898    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.688947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.688919    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.689182 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.689164    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.689223 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689188    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.689223 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689208    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.689417 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.689402    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.689456 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689420    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.689456 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689434    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.689648 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.689631    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.689709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689653    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.689709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689672    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.689924 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:45:58.689906    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.689968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689926    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.689968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.689939    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.690166 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690149    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.690213 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690168    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.690338 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690324    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.690374 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690338    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.690552 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690533    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.690610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690553    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.690750 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690730    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.690750 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690747    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.690961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690947    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.691004 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.690961    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.691154 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691141    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.691213 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691154    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.691326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691312    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.691367 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691325    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.691526 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691506    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.691566 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691526    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.691712 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691695    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.691847 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691712    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.691955 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691939    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.691995 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.691956    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.692162 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692136    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.692221 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692162    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.692357 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692342    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.692406 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692357    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.692546 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692531    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.692588 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692547    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.692744 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692730    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.692782 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692743    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.692971 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692953    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.693021 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.692970    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.693213 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693196    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.693261 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693214    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.693408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693387    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.693461 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693409    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.693565 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693550    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.693606 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693565    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.693741 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693718    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.693779 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693740    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.693952 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693937    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.693952 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.693951    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.694175 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694138    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.694175 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694154    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.694403 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694348    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.694403 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694392    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.694722 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694693    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.694722 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.694715    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.695069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695012    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.695069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695033    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.695331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695306    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.695331 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695329    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.695610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695591    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.695610 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695611    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.695921 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695903    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.695986 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.695921    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.696166 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696128    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.696228 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696168    2564 scope.go:117] "RemoveContainer" containerID="d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"
May 28 19:45:58.696407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696382    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de"} err="failed to get container status \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": rpc error: code = NotFound desc = could not find container \"d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de\": container with ID starting with d5a64fa8b8dbbe68802dd953754f93c225cd94555e9576181a8ec5d44c4bb9de not found: ID does not exist"
May 28 19:45:58.696461 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696409    2564 scope.go:117] "RemoveContainer" containerID="ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"
May 28 19:45:58.696630 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696579    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d"} err="failed to get container status \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": rpc error: code = NotFound desc = could not find container \"ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d\": container with ID starting with ad5dcb4e173a15c01b9f8a486a961f8c4d18b92e182564b256eca9b78fdf551d not found: ID does not exist"
May 28 19:45:58.696708 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696628    2564 scope.go:117] "RemoveContainer" containerID="3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"
May 28 19:45:58.696708 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696687    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:58.696871 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696848    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e"} err="failed to get container status \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": rpc error: code = NotFound desc = could not find container \"3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e\": container with ID starting with 3820558e4cd2f493eeaaca251cab5f56acb1c07cd11b6fc1740214a69f2ca03e not found: ID does not exist"
May 28 19:45:58.696927 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.696872    2564 scope.go:117] "RemoveContainer" containerID="057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"
May 28 19:45:58.697119 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697090    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1"} err="failed to get container status \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": rpc error: code = NotFound desc = could not find container \"057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1\": container with ID starting with 057be797dddc9fba9012781fb3442a13ee94a2f393f509e1e54b9ca8873d81a1 not found: ID does not exist"
May 28 19:45:58.697119 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697118    2564 scope.go:117] "RemoveContainer" containerID="e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="init-config-reloader"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697154    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="init-config-reloader"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697169    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="thanos-sidecar"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697177    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="thanos-sidecar"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697188    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-web"
May 28 19:45:58.697286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697196    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-web"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697348    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="config-reloader"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697362    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="config-reloader"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697379    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697389    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697415    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="prometheus"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697423    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="prometheus"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697436    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-thanos"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697443    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-thanos"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697526    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="config-reloader"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697539    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-web"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697550    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="thanos-sidecar"
May 28 19:45:58.697562 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697561    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697571    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="kube-rbac-proxy-thanos"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697583    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" containerName="prometheus"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697640    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e"} err="failed to get container status \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": rpc error: code = NotFound desc = could not find container \"e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e\": container with ID starting with e92e2928dc3f00327a4db6be27320b810199d9a35c591297a9ff52dec2eeea6e not found: ID does not exist"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697667    2564 scope.go:117] "RemoveContainer" containerID="1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.697967    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6"} err="failed to get container status \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": rpc error: code = NotFound desc = could not find container \"1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6\": container with ID starting with 1bad98e8e1eadfb3947e85fd7e9032e1eea8e654891363743d7881fd0bd4c6b6 not found: ID does not exist"
May 28 19:45:58.698039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.698000    2564 scope.go:117] "RemoveContainer" containerID="15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"
May 28 19:45:58.698354 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.698259    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7"} err="failed to get container status \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": rpc error: code = NotFound desc = could not find container \"15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7\": container with ID starting with 15604eb099daa54793c852449f5dd9339adbe09aea75e2e6531475efe6f36fc7 not found: ID does not exist"
May 28 19:45:58.703148 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.703131    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.705853 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.705832    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 19:45:58.705968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.705903    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 19:45:58.705968 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.705923    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 19:45:58.706073 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.705966    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9t82g\""
May 28 19:45:58.706073 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.705995    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 19:45:58.706233 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706216    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7tramuldddfam\""
May 28 19:45:58.706233 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706215    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 19:45:58.706370 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706354    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 19:45:58.706433 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706415    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 19:45:58.706491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706430    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 19:45:58.706491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706482    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 19:45:58.706849 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706833    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 19:45:58.706913 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.706897    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 19:45:58.709731 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.709711    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 19:45:58.712422 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.712403    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 19:45:58.714782 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.714761    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:58.823872 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824050 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.823984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cfsj\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-kube-api-access-2cfsj\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824212 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.824347 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.824337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925564 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925492    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925564 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925535    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925561    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925590    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925619    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925655    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cfsj\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-kube-api-access-2cfsj\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925684    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925717    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925743    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.925780 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925775    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925826    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925856    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925880    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925904    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925932    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925955    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.925988    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.926044    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.926571 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.926515    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.927043 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.927016    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.928425 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.928397    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.928654    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.928664    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.928810    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.929082    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.929127    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.929154    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929699 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.929677    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.929776 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.929684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.930122 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.930102    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.930162 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.930143    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.930748 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.930732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.931129 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.931106    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.931266 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.931246    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.931912 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.931895    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:58.934275 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:58.934259    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cfsj\" (UniqueName: \"kubernetes.io/projected/8c70e2f1-6453-47cc-81c6-acbee8f3d21b-kube-api-access-2cfsj\") pod \"prometheus-k8s-0\" (UID: \"8c70e2f1-6453-47cc-81c6-acbee8f3d21b\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:59.015161 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.015124    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:45:59.051481 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.051441    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6cc8969-e517-4001-85d7-5ee7a28e8e97" path="/var/lib/kubelet/pods/a6cc8969-e517-4001-85d7-5ee7a28e8e97/volumes"
May 28 19:45:59.154035 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.153951    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 19:45:59.156195 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:45:59.156166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c70e2f1_6453_47cc_81c6_acbee8f3d21b.slice/crio-d73b56ced6ad687ef9f3f35623762c623ccb290d25cf39585be76dd7d66ee9ed WatchSource:0}: Error finding container d73b56ced6ad687ef9f3f35623762c623ccb290d25cf39585be76dd7d66ee9ed: Status 404 returned error can't find the container with id d73b56ced6ad687ef9f3f35623762c623ccb290d25cf39585be76dd7d66ee9ed
May 28 19:45:59.644754 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.644723    2564 generic.go:358] "Generic (PLEG): container finished" podID="8c70e2f1-6453-47cc-81c6-acbee8f3d21b" containerID="78ea651c62ae28cf6f3d9b6d51bd3081453e3a1a6880ac0235a9bb4d43bfbb9f" exitCode=0
May 28 19:45:59.645218 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.644807    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerDied","Data":"78ea651c62ae28cf6f3d9b6d51bd3081453e3a1a6880ac0235a9bb4d43bfbb9f"}
May 28 19:45:59.645218 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:45:59.644829    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"d73b56ced6ad687ef9f3f35623762c623ccb290d25cf39585be76dd7d66ee9ed"}
May 28 19:46:00.651486 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651449    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"7affc3e0700e311c464b352cf09d51864f5dd499559f1cb20d007e9c33f084a0"}
May 28 19:46:00.651486 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651487    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"9fded820c65ec9ef2f416a3cfebb935a8a783ee942948be3ffb7513ed40834df"}
May 28 19:46:00.651935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651499    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"25ca07d5f5614451e5c94a9b3e62c8e1a0c178bf4551db7263bd9c720f63d790"}
May 28 19:46:00.651935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651509    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"343c40de67dd92cf50712cf62ff45d3dc1d4bc898625d130be5f51682d8f6dc5"}
May 28 19:46:00.651935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651517    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"70db4f205516eafdda420fcc2b24f9fc2b2f0a5d9a56fc9a964e511b53da5fc5"}
May 28 19:46:00.651935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.651524    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c70e2f1-6453-47cc-81c6-acbee8f3d21b","Type":"ContainerStarted","Data":"4a5082f4d1f97ec9ec86a5faea5678a585d44dae6198c08dd72b20edee3aaa49"}
May 28 19:46:00.685716 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:00.685647    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.685629258 podStartE2EDuration="2.685629258s" podCreationTimestamp="2026-05-28 19:45:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:46:00.683568092 +0000 UTC m=+142.289132561" watchObservedRunningTime="2026-05-28 19:46:00.685629258 +0000 UTC m=+142.291193697"
May 28 19:46:04.015704 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:04.015659    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:46:19.750960 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.750923    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 19:46:19.755595 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.755572    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.766945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.766920    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 19:46:19.915589 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915983 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhgf\" (UniqueName: \"kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:19.915983 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:19.915880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017038 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.016947    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017038 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.016999    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017038 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017028    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017057    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017158    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhgf\" (UniqueName: \"kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017205    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017851 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017779    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017851 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017815    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.017851 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.017815    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.018089 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.018066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.019483 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.019460    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.019578 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.019541    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.026091 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.026072    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhgf\" (UniqueName: \"kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf\") pod \"console-9df697855-z7zmh\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") " pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.064545 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.064509    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:20.192204 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.192138    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 19:46:20.194843 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:46:20.194811    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ce81bb_af5f_474e_bd41_469a06eba930.slice/crio-2bb519c05b17f5ea93ea9fc560757e6d726f8b71b2f686859e78cab56f14d819 WatchSource:0}: Error finding container 2bb519c05b17f5ea93ea9fc560757e6d726f8b71b2f686859e78cab56f14d819: Status 404 returned error can't find the container with id 2bb519c05b17f5ea93ea9fc560757e6d726f8b71b2f686859e78cab56f14d819
May 28 19:46:20.714346 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.714303    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9df697855-z7zmh" event={"ID":"04ce81bb-af5f-474e-bd41-469a06eba930","Type":"ContainerStarted","Data":"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"}
May 28 19:46:20.714346 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.714344    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9df697855-z7zmh" event={"ID":"04ce81bb-af5f-474e-bd41-469a06eba930","Type":"ContainerStarted","Data":"2bb519c05b17f5ea93ea9fc560757e6d726f8b71b2f686859e78cab56f14d819"}
May 28 19:46:20.733143 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:20.733090    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9df697855-z7zmh" podStartSLOduration=1.733074687 podStartE2EDuration="1.733074687s" podCreationTimestamp="2026-05-28 19:46:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:46:20.732006877 +0000 UTC m=+162.337571308" watchObservedRunningTime="2026-05-28 19:46:20.733074687 +0000 UTC m=+162.338639117"
May 28 19:46:30.064656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.064575    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:30.064656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.064622    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:30.068952 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.068930    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:30.695500 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.695468    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jpkhg"]
May 28 19:46:30.699041 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.699022    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.702302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.702287    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 19:46:30.706594 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.706571    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpkhg"]
May 28 19:46:30.751574 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.751548    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9df697855-z7zmh"
May 28 19:46:30.801057 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.801027    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:46:30.816202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.816072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-dbus\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.816202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.816183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-kubelet-config\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.816421 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.816226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-original-pull-secret\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.917536 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.917496    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-dbus\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.917719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.917552    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-kubelet-config\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.917719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.917581    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-original-pull-secret\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.917719 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.917686    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-dbus\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.917854 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.917686    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-kubelet-config\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:30.919844 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:30.919819    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/517a8bc4-e5e9-48cc-8439-64b492e5f0b2-original-pull-secret\") pod \"global-pull-secret-syncer-jpkhg\" (UID: \"517a8bc4-e5e9-48cc-8439-64b492e5f0b2\") " pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:31.009136 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:31.009031    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpkhg"
May 28 19:46:31.132259 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:31.132142    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpkhg"]
May 28 19:46:31.134969 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:46:31.134934    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517a8bc4_e5e9_48cc_8439_64b492e5f0b2.slice/crio-0759d06dc3d6e10796788f7db0d63be18534d59e5ab7121c5e85ed944fa5f8e9 WatchSource:0}: Error finding container 0759d06dc3d6e10796788f7db0d63be18534d59e5ab7121c5e85ed944fa5f8e9: Status 404 returned error can't find the container with id 0759d06dc3d6e10796788f7db0d63be18534d59e5ab7121c5e85ed944fa5f8e9
May 28 19:46:31.751101 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:31.751071    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpkhg" event={"ID":"517a8bc4-e5e9-48cc-8439-64b492e5f0b2","Type":"ContainerStarted","Data":"0759d06dc3d6e10796788f7db0d63be18534d59e5ab7121c5e85ed944fa5f8e9"}
May 28 19:46:38.773150 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:38.773112    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpkhg" event={"ID":"517a8bc4-e5e9-48cc-8439-64b492e5f0b2","Type":"ContainerStarted","Data":"5a79891a6fe0916b0611f0d59f8203e179bb40570dece94a61b47ce3bc771f24"}
May 28 19:46:38.792711 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:38.792666    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jpkhg" podStartSLOduration=1.879415924 podStartE2EDuration="8.792652676s" podCreationTimestamp="2026-05-28 19:46:30 +0000 UTC" firstStartedPulling="2026-05-28 19:46:31.136515188 +0000 UTC m=+172.742079596" lastFinishedPulling="2026-05-28 19:46:38.049751927 +0000 UTC m=+179.655316348" observedRunningTime="2026-05-28 19:46:38.7921245 +0000 UTC m=+180.397688933" watchObservedRunningTime="2026-05-28 19:46:38.792652676 +0000 UTC m=+180.398217116"
May 28 19:46:55.820904 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:55.820839    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5797c76646-j5lpd" podUID="0acbf757-7897-4e0c-b895-68000b24b6a0" containerName="console" containerID="cri-o://5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357" gracePeriod=15
May 28 19:46:56.054190 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.054166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5797c76646-j5lpd_0acbf757-7897-4e0c-b895-68000b24b6a0/console/0.log"
May 28 19:46:56.054328 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.054233    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:46:56.150385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150353    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150403    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150422    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150469    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150491    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150529    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27jxd\" (UniqueName: \"kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150570    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca\") pod \"0acbf757-7897-4e0c-b895-68000b24b6a0\" (UID: \"0acbf757-7897-4e0c-b895-68000b24b6a0\") "
May 28 19:46:56.150920 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150757    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config" (OuterVolumeSpecName: "console-config") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:46:56.151014 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150978    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:46:56.151014 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150998    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-console-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.151014 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.150987    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:46:56.151570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.151544    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:46:56.152762 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.152735    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:46:56.152910 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.152890    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:46:56.153045 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.153024    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd" (OuterVolumeSpecName: "kube-api-access-27jxd") pod "0acbf757-7897-4e0c-b895-68000b24b6a0" (UID: "0acbf757-7897-4e0c-b895-68000b24b6a0"). InnerVolumeSpecName "kube-api-access-27jxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:46:56.252478 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252431    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-oauth-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.252478 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252466    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-trusted-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.252478 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252476    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0acbf757-7897-4e0c-b895-68000b24b6a0-console-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.252478 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252484    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-oauth-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.252742 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252495    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27jxd\" (UniqueName: \"kubernetes.io/projected/0acbf757-7897-4e0c-b895-68000b24b6a0-kube-api-access-27jxd\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.252742 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.252506    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0acbf757-7897-4e0c-b895-68000b24b6a0-service-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:46:56.826269 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826242    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5797c76646-j5lpd_0acbf757-7897-4e0c-b895-68000b24b6a0/console/0.log"
May 28 19:46:56.826670 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826282    2564 generic.go:358] "Generic (PLEG): container finished" podID="0acbf757-7897-4e0c-b895-68000b24b6a0" containerID="5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357" exitCode=2
May 28 19:46:56.826670 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826373    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5797c76646-j5lpd"
May 28 19:46:56.826670 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826385    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5797c76646-j5lpd" event={"ID":"0acbf757-7897-4e0c-b895-68000b24b6a0","Type":"ContainerDied","Data":"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"}
May 28 19:46:56.826670 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826426    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5797c76646-j5lpd" event={"ID":"0acbf757-7897-4e0c-b895-68000b24b6a0","Type":"ContainerDied","Data":"880497cc06b8de55b148afc79349011954de2fdbd23ccbbdd0ce3b08dac4a6eb"}
May 28 19:46:56.826670 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.826443    2564 scope.go:117] "RemoveContainer" containerID="5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"
May 28 19:46:56.834775 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.834758    2564 scope.go:117] "RemoveContainer" containerID="5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"
May 28 19:46:56.835049 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:46:56.835030    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357\": container with ID starting with 5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357 not found: ID does not exist" containerID="5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"
May 28 19:46:56.835109 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.835058    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357"} err="failed to get container status \"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357\": rpc error: code = NotFound desc = could not find container \"5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357\": container with ID starting with 5fb24dcb58945d3e1ada8cd5a09670f6a4297718f4274f6caf4c513e7b294357 not found: ID does not exist"
May 28 19:46:56.851132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.851109    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:46:56.857923 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:56.857900    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5797c76646-j5lpd"]
May 28 19:46:57.050928 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:57.050895    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0acbf757-7897-4e0c-b895-68000b24b6a0" path="/var/lib/kubelet/pods/0acbf757-7897-4e0c-b895-68000b24b6a0/volumes"
May 28 19:46:59.016111 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:59.016076    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:46:59.031375 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:59.031350    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:46:59.851766 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:46:59.851735    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 19:47:30.351976 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.351936    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fhnwm"]
May 28 19:47:30.352514 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.352285    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0acbf757-7897-4e0c-b895-68000b24b6a0" containerName="console"
May 28 19:47:30.352514 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.352298    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0acbf757-7897-4e0c-b895-68000b24b6a0" containerName="console"
May 28 19:47:30.352514 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.352363    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0acbf757-7897-4e0c-b895-68000b24b6a0" containerName="console"
May 28 19:47:30.354102 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.354085    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.356901 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.356874    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 19:47:30.357004 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.356957    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rpzp6\""
May 28 19:47:30.357004 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.356957    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 19:47:30.363394 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.363371    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fhnwm"]
May 28 19:47:30.454551 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.454505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.454723 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.454566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js69w\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-kube-api-access-js69w\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.555337 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.555302    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.555478 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.555351    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js69w\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-kube-api-access-js69w\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.564586 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.564551    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.564703 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.564621    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js69w\" (UniqueName: \"kubernetes.io/projected/5d304a58-2831-45e7-8ba9-147eb8c33600-kube-api-access-js69w\") pod \"cert-manager-cainjector-68b757865b-fhnwm\" (UID: \"5d304a58-2831-45e7-8ba9-147eb8c33600\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.670936 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.670899    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm"
May 28 19:47:30.803115 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.803086    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fhnwm"]
May 28 19:47:30.806751 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:47:30.806721    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d304a58_2831_45e7_8ba9_147eb8c33600.slice/crio-e500416709471770ec13ae8d7881973f438ab71f0c173fc5505adddcffe031e1 WatchSource:0}: Error finding container e500416709471770ec13ae8d7881973f438ab71f0c173fc5505adddcffe031e1: Status 404 returned error can't find the container with id e500416709471770ec13ae8d7881973f438ab71f0c173fc5505adddcffe031e1
May 28 19:47:30.927567 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:30.927480    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm" event={"ID":"5d304a58-2831-45e7-8ba9-147eb8c33600","Type":"ContainerStarted","Data":"e500416709471770ec13ae8d7881973f438ab71f0c173fc5505adddcffe031e1"}
May 28 19:47:33.942914 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:33.942877    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm" event={"ID":"5d304a58-2831-45e7-8ba9-147eb8c33600","Type":"ContainerStarted","Data":"338ecac4d59f82ff868df6a212f9996a3b368f37ff09947d2219b26640b6ac14"}
May 28 19:47:34.006638 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:34.006581    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-fhnwm" podStartSLOduration=1.409884701 podStartE2EDuration="4.00656763s" podCreationTimestamp="2026-05-28 19:47:30 +0000 UTC" firstStartedPulling="2026-05-28 19:47:30.808939842 +0000 UTC m=+232.414504249" lastFinishedPulling="2026-05-28 19:47:33.40562277 +0000 UTC m=+235.011187178" observedRunningTime="2026-05-28 19:47:34.005865898 +0000 UTC m=+235.611430328" watchObservedRunningTime="2026-05-28 19:47:34.00656763 +0000 UTC m=+235.612132060"
May 28 19:47:48.397247 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.397218    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hs9vg"]
May 28 19:47:48.402808 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.402772    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.405141 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.405120    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hhslh\""
May 28 19:47:48.408039 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.408016    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hs9vg"]
May 28 19:47:48.419143 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.419084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tph\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-kube-api-access-c4tph\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.419315 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.419247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-bound-sa-token\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.520442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.520392    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-bound-sa-token\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.520442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.520461    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tph\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-kube-api-access-c4tph\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.529341 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.529314    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-bound-sa-token\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.529470 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.529453    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tph\" (UniqueName: \"kubernetes.io/projected/51183041-5958-406d-964f-79d3c959b294-kube-api-access-c4tph\") pod \"cert-manager-79c8d999ff-hs9vg\" (UID: \"51183041-5958-406d-964f-79d3c959b294\") " pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.712954 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.712855    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-hs9vg"
May 28 19:47:48.835302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.835250    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hs9vg"]
May 28 19:47:48.837839 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:47:48.837815    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51183041_5958_406d_964f_79d3c959b294.slice/crio-adacb978c6572b6d71e5d6ebec282119b2a10492887264711bbfa3078ee62763 WatchSource:0}: Error finding container adacb978c6572b6d71e5d6ebec282119b2a10492887264711bbfa3078ee62763: Status 404 returned error can't find the container with id adacb978c6572b6d71e5d6ebec282119b2a10492887264711bbfa3078ee62763
May 28 19:47:48.986407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.986330    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-hs9vg" event={"ID":"51183041-5958-406d-964f-79d3c959b294","Type":"ContainerStarted","Data":"b3ad5710c74342c5d9287e6435d7b4d92801d2da67d5f8b9e64e50ea608b0300"}
May 28 19:47:48.986407 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:48.986364    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-hs9vg" event={"ID":"51183041-5958-406d-964f-79d3c959b294","Type":"ContainerStarted","Data":"adacb978c6572b6d71e5d6ebec282119b2a10492887264711bbfa3078ee62763"}
May 28 19:47:49.003088 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:47:49.003042    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-hs9vg" podStartSLOduration=1.003028648 podStartE2EDuration="1.003028648s" podCreationTimestamp="2026-05-28 19:47:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:47:49.00178239 +0000 UTC m=+250.607346830" watchObservedRunningTime="2026-05-28 19:47:49.003028648 +0000 UTC m=+250.608593078"
May 28 19:48:02.137148 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.137059    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"]
May 28 19:48:02.140388 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.140367    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.143965 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.143947    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 19:48:02.144064 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.144042    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 19:48:02.144290 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.144266    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jbt6w\""
May 28 19:48:02.144680 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.144658    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 19:48:02.145195 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.145181    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 19:48:02.151577 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.151556    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"]
May 28 19:48:02.242871 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.242832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.243056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.242911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.243056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.242981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx5m4\" (UniqueName: \"kubernetes.io/projected/a32f1b69-3646-465e-9553-67df766a6890-kube-api-access-cx5m4\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.344491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.344452    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.344696 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.344500    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.344696 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.344559    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx5m4\" (UniqueName: \"kubernetes.io/projected/a32f1b69-3646-465e-9553-67df766a6890-kube-api-access-cx5m4\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.346972 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.346947    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.347078 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.346980    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a32f1b69-3646-465e-9553-67df766a6890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.352457 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.352432    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx5m4\" (UniqueName: \"kubernetes.io/projected/a32f1b69-3646-465e-9553-67df766a6890-kube-api-access-cx5m4\") pod \"opendatahub-operator-controller-manager-69568b6749-qd5vl\" (UID: \"a32f1b69-3646-465e-9553-67df766a6890\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.451679 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.451643    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:02.577876 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:02.577848    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"]
May 28 19:48:02.580461 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:48:02.580432    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32f1b69_3646_465e_9553_67df766a6890.slice/crio-05691098c34adf862af719783837a7050cab28478a3c5aec33f0573f1b105fac WatchSource:0}: Error finding container 05691098c34adf862af719783837a7050cab28478a3c5aec33f0573f1b105fac: Status 404 returned error can't find the container with id 05691098c34adf862af719783837a7050cab28478a3c5aec33f0573f1b105fac
May 28 19:48:03.031517 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:03.031484    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl" event={"ID":"a32f1b69-3646-465e-9553-67df766a6890","Type":"ContainerStarted","Data":"05691098c34adf862af719783837a7050cab28478a3c5aec33f0573f1b105fac"}
May 28 19:48:06.043784 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:06.043744    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl" event={"ID":"a32f1b69-3646-465e-9553-67df766a6890","Type":"ContainerStarted","Data":"38104b49caf0653aec1b103caded38ef6438780ced10cd9dd0cff3a4ab5d0d6f"}
May 28 19:48:06.044214 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:06.044014    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:06.063545 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:06.063496    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl" podStartSLOduration=1.291698332 podStartE2EDuration="4.063481545s" podCreationTimestamp="2026-05-28 19:48:02 +0000 UTC" firstStartedPulling="2026-05-28 19:48:02.582241982 +0000 UTC m=+264.187806401" lastFinishedPulling="2026-05-28 19:48:05.354025203 +0000 UTC m=+266.959589614" observedRunningTime="2026-05-28 19:48:06.063097189 +0000 UTC m=+267.668661620" watchObservedRunningTime="2026-05-28 19:48:06.063481545 +0000 UTC m=+267.669045975"
May 28 19:48:17.051961 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:17.051931    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-qd5vl"
May 28 19:48:21.941104 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.941066    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"]
May 28 19:48:21.945619 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.945601    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:21.948385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.948356    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 19:48:21.949549 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.949530    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 19:48:21.949695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.949609    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 19:48:21.949781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.949716    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m2qrp\""
May 28 19:48:21.949781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.949753    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 19:48:21.949781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.949762    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 19:48:21.964843 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:21.964819    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"]
May 28 19:48:22.123007 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.122968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4130a110-298e-4a1a-9ec4-6d98d7744883-manager-config\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.123007 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.123010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.123259 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.123051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.123259 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.123136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knnkm\" (UniqueName: \"kubernetes.io/projected/4130a110-298e-4a1a-9ec4-6d98d7744883-kube-api-access-knnkm\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.224416 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.224321    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4130a110-298e-4a1a-9ec4-6d98d7744883-manager-config\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.224416 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.224365    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.224693 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.224502    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.224693 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.224539    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knnkm\" (UniqueName: \"kubernetes.io/projected/4130a110-298e-4a1a-9ec4-6d98d7744883-kube-api-access-knnkm\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.225084 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.225051    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4130a110-298e-4a1a-9ec4-6d98d7744883-manager-config\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.227041 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.227012    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.227125 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.227012    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4130a110-298e-4a1a-9ec4-6d98d7744883-cert\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.249945 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.249914    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knnkm\" (UniqueName: \"kubernetes.io/projected/4130a110-298e-4a1a-9ec4-6d98d7744883-kube-api-access-knnkm\") pod \"lws-controller-manager-9cd786b7b-j5zwk\" (UID: \"4130a110-298e-4a1a-9ec4-6d98d7744883\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.254790 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.254768    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:22.389738 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:22.389699    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"]
May 28 19:48:22.393714 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:48:22.393689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4130a110_298e_4a1a_9ec4_6d98d7744883.slice/crio-d1ea726fb2c6e1bc0008ff514a3031f8e37ecf49bc26970fe72f367f3e43b217 WatchSource:0}: Error finding container d1ea726fb2c6e1bc0008ff514a3031f8e37ecf49bc26970fe72f367f3e43b217: Status 404 returned error can't find the container with id d1ea726fb2c6e1bc0008ff514a3031f8e37ecf49bc26970fe72f367f3e43b217
May 28 19:48:23.097293 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:23.097255    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk" event={"ID":"4130a110-298e-4a1a-9ec4-6d98d7744883","Type":"ContainerStarted","Data":"d1ea726fb2c6e1bc0008ff514a3031f8e37ecf49bc26970fe72f367f3e43b217"}
May 28 19:48:26.109706 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:26.109668    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk" event={"ID":"4130a110-298e-4a1a-9ec4-6d98d7744883","Type":"ContainerStarted","Data":"34939a2f39cb3a66dccbfa0525e632629c2799b11a90a14e7355a957ffbd9923"}
May 28 19:48:26.110120 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:26.109837    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:26.132471 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:26.132407    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk" podStartSLOduration=2.29982717 podStartE2EDuration="5.132393556s" podCreationTimestamp="2026-05-28 19:48:21 +0000 UTC" firstStartedPulling="2026-05-28 19:48:22.395546334 +0000 UTC m=+284.001110742" lastFinishedPulling="2026-05-28 19:48:25.228112717 +0000 UTC m=+286.833677128" observedRunningTime="2026-05-28 19:48:26.130607892 +0000 UTC m=+287.736172323" watchObservedRunningTime="2026-05-28 19:48:26.132393556 +0000 UTC m=+287.737957986"
May 28 19:48:37.115445 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:37.115413    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-j5zwk"
May 28 19:48:38.921660 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:38.921627    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:48:38.922137 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:38.921726    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:48:38.927267 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:38.927247    2564 kubelet.go:1628] "Image garbage collection succeeded"
May 28 19:48:51.104261 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.104227    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"]
May 28 19:48:51.106423 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.106406    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.109088 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.109066    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 19:48:51.109210 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.109161    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 19:48:51.109285 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.109269    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dbr95\""
May 28 19:48:51.109374 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.109359    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 19:48:51.119996 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.119975    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"]
May 28 19:48:51.174548 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174743 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174944 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174944 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174944 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z4bt\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-kube-api-access-9z4bt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.174944 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.174860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276122 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276087    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276122 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276136    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276363 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276197    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276363 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276230    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276363 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276276    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276363 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276314    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276363 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276335    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276673 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276840 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276681    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276915 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276875    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z4bt\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-kube-api-access-9z4bt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276915 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276900    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276988 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276690    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276988 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.276988 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.276738    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.278638 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.278597    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.278960 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.278909    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.284820 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.284779    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.284936 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.284919    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z4bt\" (UniqueName: \"kubernetes.io/projected/49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01-kube-api-access-9z4bt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h\" (UID: \"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.416442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.416407    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:51.548939 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.548911    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"]
May 28 19:48:51.551521 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:48:51.551493    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49dcf28f_7fcb_4fcb_b5b7_87564b8b3b01.slice/crio-32715eb8354a961b250be8e501f700fb350c5af885a520a49f88a392bb289e34 WatchSource:0}: Error finding container 32715eb8354a961b250be8e501f700fb350c5af885a520a49f88a392bb289e34: Status 404 returned error can't find the container with id 32715eb8354a961b250be8e501f700fb350c5af885a520a49f88a392bb289e34
May 28 19:48:51.553313 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:51.553296    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:48:52.195304 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:52.195270    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h" event={"ID":"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01","Type":"ContainerStarted","Data":"32715eb8354a961b250be8e501f700fb350c5af885a520a49f88a392bb289e34"}
May 28 19:48:54.741543 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:54.741506    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:48:54.741838 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:54.741581    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:48:54.741838 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:54.741609    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:48:55.205944 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:55.205910    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h" event={"ID":"49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01","Type":"ContainerStarted","Data":"47382ec59a977650280648e946eb64e3abf56759759d40a41cff7e9399a85d26"}
May 28 19:48:55.228772 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:55.228548    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h" podStartSLOduration=1.040712229 podStartE2EDuration="4.22853013s" podCreationTimestamp="2026-05-28 19:48:51 +0000 UTC" firstStartedPulling="2026-05-28 19:48:51.553435363 +0000 UTC m=+313.158999772" lastFinishedPulling="2026-05-28 19:48:54.741253263 +0000 UTC m=+316.346817673" observedRunningTime="2026-05-28 19:48:55.227993022 +0000 UTC m=+316.833557451" watchObservedRunningTime="2026-05-28 19:48:55.22853013 +0000 UTC m=+316.834094561"
May 28 19:48:55.416889 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:55.416843    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:55.421322 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:55.421295    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:56.209403 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:56.209363    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:48:56.210437 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:48:56.210415    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h"
May 28 19:49:20.275389 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.275359    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:20.282059 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.282036    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:20.286459 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.286430    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-p7mfp\""
May 28 19:49:20.286631 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.286536    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 19:49:20.287437 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.287354    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 19:49:20.291030 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.291001    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:20.356401 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.356365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99l8\" (UniqueName: \"kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8\") pod \"kuadrant-operator-catalog-s6cwh\" (UID: \"7dab29eb-8bca-44b1-8821-1f9f79de1156\") " pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:20.457348 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.457313    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k99l8\" (UniqueName: \"kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8\") pod \"kuadrant-operator-catalog-s6cwh\" (UID: \"7dab29eb-8bca-44b1-8821-1f9f79de1156\") " pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:20.469404 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.469372    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99l8\" (UniqueName: \"kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8\") pod \"kuadrant-operator-catalog-s6cwh\" (UID: \"7dab29eb-8bca-44b1-8821-1f9f79de1156\") " pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:20.594184 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.594093    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:20.621428 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.620745    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:20.742730 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.742706    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:20.745104 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:49:20.745074    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dab29eb_8bca_44b1_8821_1f9f79de1156.slice/crio-fa9d607c90ed36860dfc676df6ab08f2c3877447576987d36fece580fcef4b04 WatchSource:0}: Error finding container fa9d607c90ed36860dfc676df6ab08f2c3877447576987d36fece580fcef4b04: Status 404 returned error can't find the container with id fa9d607c90ed36860dfc676df6ab08f2c3877447576987d36fece580fcef4b04
May 28 19:49:20.835567 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.835533    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9kd8"]
May 28 19:49:20.840342 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.840322    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:20.847132 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.847071    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9kd8"]
May 28 19:49:20.962242 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:20.962205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvmpx\" (UniqueName: \"kubernetes.io/projected/11d9c48f-819c-4640-b46e-c2b3d362c3f7-kube-api-access-gvmpx\") pod \"kuadrant-operator-catalog-b9kd8\" (UID: \"11d9c48f-819c-4640-b46e-c2b3d362c3f7\") " pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:21.063486 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:21.063454    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvmpx\" (UniqueName: \"kubernetes.io/projected/11d9c48f-819c-4640-b46e-c2b3d362c3f7-kube-api-access-gvmpx\") pod \"kuadrant-operator-catalog-b9kd8\" (UID: \"11d9c48f-819c-4640-b46e-c2b3d362c3f7\") " pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:21.072831 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:21.072783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvmpx\" (UniqueName: \"kubernetes.io/projected/11d9c48f-819c-4640-b46e-c2b3d362c3f7-kube-api-access-gvmpx\") pod \"kuadrant-operator-catalog-b9kd8\" (UID: \"11d9c48f-819c-4640-b46e-c2b3d362c3f7\") " pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:21.151495 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:21.151456    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:21.294403 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:21.294341    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9kd8"]
May 28 19:49:21.297076 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:21.297047    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" event={"ID":"7dab29eb-8bca-44b1-8821-1f9f79de1156","Type":"ContainerStarted","Data":"fa9d607c90ed36860dfc676df6ab08f2c3877447576987d36fece580fcef4b04"}
May 28 19:49:21.334217 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:49:21.334177    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d9c48f_819c_4640_b46e_c2b3d362c3f7.slice/crio-b106f418438e201ff2a3518fcec7bd14dd4a73490bbb338b4c2e98ff898d1fa4 WatchSource:0}: Error finding container b106f418438e201ff2a3518fcec7bd14dd4a73490bbb338b4c2e98ff898d1fa4: Status 404 returned error can't find the container with id b106f418438e201ff2a3518fcec7bd14dd4a73490bbb338b4c2e98ff898d1fa4
May 28 19:49:22.301492 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:22.301458    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8" event={"ID":"11d9c48f-819c-4640-b46e-c2b3d362c3f7","Type":"ContainerStarted","Data":"b106f418438e201ff2a3518fcec7bd14dd4a73490bbb338b4c2e98ff898d1fa4"}
May 28 19:49:23.305671 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.305571    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" event={"ID":"7dab29eb-8bca-44b1-8821-1f9f79de1156","Type":"ContainerStarted","Data":"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"}
May 28 19:49:23.305671 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.305597    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" podUID="7dab29eb-8bca-44b1-8821-1f9f79de1156" containerName="registry-server" containerID="cri-o://85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f" gracePeriod=2
May 28 19:49:23.306857 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.306827    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8" event={"ID":"11d9c48f-819c-4640-b46e-c2b3d362c3f7","Type":"ContainerStarted","Data":"851c247a62f70329b1925ace43bf13fb1a18c812253b8d3815bd1d268be852b1"}
May 28 19:49:23.322888 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.322841    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" podStartSLOduration=1.261299747 podStartE2EDuration="3.322823266s" podCreationTimestamp="2026-05-28 19:49:20 +0000 UTC" firstStartedPulling="2026-05-28 19:49:20.746408478 +0000 UTC m=+342.351972885" lastFinishedPulling="2026-05-28 19:49:22.807931984 +0000 UTC m=+344.413496404" observedRunningTime="2026-05-28 19:49:23.321606588 +0000 UTC m=+344.927171019" watchObservedRunningTime="2026-05-28 19:49:23.322823266 +0000 UTC m=+344.928387692"
May 28 19:49:23.337713 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.337659    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8" podStartSLOduration=1.862322904 podStartE2EDuration="3.337643302s" podCreationTimestamp="2026-05-28 19:49:20 +0000 UTC" firstStartedPulling="2026-05-28 19:49:21.335806785 +0000 UTC m=+342.941371204" lastFinishedPulling="2026-05-28 19:49:22.811127177 +0000 UTC m=+344.416691602" observedRunningTime="2026-05-28 19:49:23.33671783 +0000 UTC m=+344.942282274" watchObservedRunningTime="2026-05-28 19:49:23.337643302 +0000 UTC m=+344.943207758"
May 28 19:49:23.548304 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.548280    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:23.589469 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.589395    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k99l8\" (UniqueName: \"kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8\") pod \"7dab29eb-8bca-44b1-8821-1f9f79de1156\" (UID: \"7dab29eb-8bca-44b1-8821-1f9f79de1156\") "
May 28 19:49:23.591494 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.591461    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8" (OuterVolumeSpecName: "kube-api-access-k99l8") pod "7dab29eb-8bca-44b1-8821-1f9f79de1156" (UID: "7dab29eb-8bca-44b1-8821-1f9f79de1156"). InnerVolumeSpecName "kube-api-access-k99l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:49:23.690782 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:23.690751    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k99l8\" (UniqueName: \"kubernetes.io/projected/7dab29eb-8bca-44b1-8821-1f9f79de1156-kube-api-access-k99l8\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:49:24.310981 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.310948    2564 generic.go:358] "Generic (PLEG): container finished" podID="7dab29eb-8bca-44b1-8821-1f9f79de1156" containerID="85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f" exitCode=0
May 28 19:49:24.311431 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.311010    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh"
May 28 19:49:24.311431 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.311033    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" event={"ID":"7dab29eb-8bca-44b1-8821-1f9f79de1156","Type":"ContainerDied","Data":"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"}
May 28 19:49:24.311431 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.311067    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s6cwh" event={"ID":"7dab29eb-8bca-44b1-8821-1f9f79de1156","Type":"ContainerDied","Data":"fa9d607c90ed36860dfc676df6ab08f2c3877447576987d36fece580fcef4b04"}
May 28 19:49:24.311431 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.311087    2564 scope.go:117] "RemoveContainer" containerID="85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"
May 28 19:49:24.319573 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.319554    2564 scope.go:117] "RemoveContainer" containerID="85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"
May 28 19:49:24.319856 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:49:24.319834    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f\": container with ID starting with 85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f not found: ID does not exist" containerID="85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"
May 28 19:49:24.319920 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.319864    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f"} err="failed to get container status \"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f\": rpc error: code = NotFound desc = could not find container \"85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f\": container with ID starting with 85af200c86a260bba4ed9b26fd7f79e84142bb9ee3b4972e859244f54447038f not found: ID does not exist"
May 28 19:49:24.334660 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.334629    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:24.336717 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:24.336691    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s6cwh"]
May 28 19:49:25.057208 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:25.057176    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dab29eb-8bca-44b1-8821-1f9f79de1156" path="/var/lib/kubelet/pods/7dab29eb-8bca-44b1-8821-1f9f79de1156/volumes"
May 28 19:49:31.152479 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:31.152440    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:31.152976 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:31.152493    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:31.174294 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:31.174263    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:31.356423 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:31.356392    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-b9kd8"
May 28 19:49:46.752842 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.752783    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"]
May 28 19:49:46.753250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.753148    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dab29eb-8bca-44b1-8821-1f9f79de1156" containerName="registry-server"
May 28 19:49:46.753250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.753158    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dab29eb-8bca-44b1-8821-1f9f79de1156" containerName="registry-server"
May 28 19:49:46.753250 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.753229    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="7dab29eb-8bca-44b1-8821-1f9f79de1156" containerName="registry-server"
May 28 19:49:46.761392 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.761372    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:46.764234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.764215    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-977lg\""
May 28 19:49:46.767056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.767034    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"]
May 28 19:49:46.902617 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:46.902584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghvw\" (UniqueName: \"kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw\") pod \"limitador-operator-controller-manager-85c4996f8c-jljgd\" (UID: \"a42b2ba4-b627-4d86-a99f-b2d26b721b90\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:47.003947 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:47.003856    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cghvw\" (UniqueName: \"kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw\") pod \"limitador-operator-controller-manager-85c4996f8c-jljgd\" (UID: \"a42b2ba4-b627-4d86-a99f-b2d26b721b90\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:47.013269 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:47.013240    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghvw\" (UniqueName: \"kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw\") pod \"limitador-operator-controller-manager-85c4996f8c-jljgd\" (UID: \"a42b2ba4-b627-4d86-a99f-b2d26b721b90\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:47.072914 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:47.072883    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:47.207447 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:47.207403    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"]
May 28 19:49:47.209640 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:49:47.209611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42b2ba4_b627_4d86_a99f_b2d26b721b90.slice/crio-298f1cef4ec5f26d2f99ee667ecf41b80205a1b8d2c27ec1805f76ea8329fbf2 WatchSource:0}: Error finding container 298f1cef4ec5f26d2f99ee667ecf41b80205a1b8d2c27ec1805f76ea8329fbf2: Status 404 returned error can't find the container with id 298f1cef4ec5f26d2f99ee667ecf41b80205a1b8d2c27ec1805f76ea8329fbf2
May 28 19:49:47.392696 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:47.392657    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" event={"ID":"a42b2ba4-b627-4d86-a99f-b2d26b721b90","Type":"ContainerStarted","Data":"298f1cef4ec5f26d2f99ee667ecf41b80205a1b8d2c27ec1805f76ea8329fbf2"}
May 28 19:49:49.401150 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:49.401111    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" event={"ID":"a42b2ba4-b627-4d86-a99f-b2d26b721b90","Type":"ContainerStarted","Data":"f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691"}
May 28 19:49:49.401539 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:49.401293    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:49:49.421237 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:49.421189    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" podStartSLOduration=1.647292907 podStartE2EDuration="3.421175519s" podCreationTimestamp="2026-05-28 19:49:46 +0000 UTC" firstStartedPulling="2026-05-28 19:49:47.211643852 +0000 UTC m=+368.817208261" lastFinishedPulling="2026-05-28 19:49:48.985526453 +0000 UTC m=+370.591090873" observedRunningTime="2026-05-28 19:49:49.419714625 +0000 UTC m=+371.025279067" watchObservedRunningTime="2026-05-28 19:49:49.421175519 +0000 UTC m=+371.026739950"
May 28 19:49:50.239837 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.239788    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"]
May 28 19:49:50.243270 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.243254    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:50.246359 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.246331    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 19:49:50.246598 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.246578    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9nrh4\""
May 28 19:49:50.256568 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.256544    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"]
May 28 19:49:50.335112 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.335075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcslb\" (UniqueName: \"kubernetes.io/projected/e88d672c-9e3e-46f2-aa33-8a827a0c239d-kube-api-access-mcslb\") pod \"dns-operator-controller-manager-648d5c98bc-bkv4k\" (UID: \"e88d672c-9e3e-46f2-aa33-8a827a0c239d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:50.435946 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.435908    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcslb\" (UniqueName: \"kubernetes.io/projected/e88d672c-9e3e-46f2-aa33-8a827a0c239d-kube-api-access-mcslb\") pod \"dns-operator-controller-manager-648d5c98bc-bkv4k\" (UID: \"e88d672c-9e3e-46f2-aa33-8a827a0c239d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:50.444869 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.444843    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcslb\" (UniqueName: \"kubernetes.io/projected/e88d672c-9e3e-46f2-aa33-8a827a0c239d-kube-api-access-mcslb\") pod \"dns-operator-controller-manager-648d5c98bc-bkv4k\" (UID: \"e88d672c-9e3e-46f2-aa33-8a827a0c239d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:50.553696 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.553611    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:50.685584 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:50.685549    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"]
May 28 19:49:50.689095 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:49:50.689064    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88d672c_9e3e_46f2_aa33_8a827a0c239d.slice/crio-18d933f138ad978f210514284558e967de21ab424994b3979d77847321f951ff WatchSource:0}: Error finding container 18d933f138ad978f210514284558e967de21ab424994b3979d77847321f951ff: Status 404 returned error can't find the container with id 18d933f138ad978f210514284558e967de21ab424994b3979d77847321f951ff
May 28 19:49:51.409368 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:51.409338    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k" event={"ID":"e88d672c-9e3e-46f2-aa33-8a827a0c239d","Type":"ContainerStarted","Data":"18d933f138ad978f210514284558e967de21ab424994b3979d77847321f951ff"}
May 28 19:49:53.418001 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:53.417964    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k" event={"ID":"e88d672c-9e3e-46f2-aa33-8a827a0c239d","Type":"ContainerStarted","Data":"914005ccab0152ef7c6aac9427a8888f2f671b1413a7efddf6f444aa3c39808c"}
May 28 19:49:53.418408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:53.418099    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:49:53.437420 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:53.437366    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k" podStartSLOduration=1.326111318 podStartE2EDuration="3.437350986s" podCreationTimestamp="2026-05-28 19:49:50 +0000 UTC" firstStartedPulling="2026-05-28 19:49:50.691034023 +0000 UTC m=+372.296598430" lastFinishedPulling="2026-05-28 19:49:52.802273678 +0000 UTC m=+374.407838098" observedRunningTime="2026-05-28 19:49:53.435152132 +0000 UTC m=+375.040716574" watchObservedRunningTime="2026-05-28 19:49:53.437350986 +0000 UTC m=+375.042915416"
May 28 19:49:55.202307 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.202270    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"]
May 28 19:49:55.205785 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.205770    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.208750 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.208735    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zwhvk\""
May 28 19:49:55.224315 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.224274    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"]
May 28 19:49:55.280707 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.280671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97m4\" (UniqueName: \"kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.280707 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.280719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.381924 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.381883    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k97m4\" (UniqueName: \"kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.382118 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.381936    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.382351 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.382329    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.396271 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.396246    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97m4\" (UniqueName: \"kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.516187 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.516101    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:49:55.659305 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:55.659272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"]
May 28 19:49:55.662911 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:49:55.662881    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a05271_d470_46c0_aaea_d08126619569.slice/crio-3a08d522e0c393768c845fc69fd9aff342d137ae48ae91de52d9796190271c43 WatchSource:0}: Error finding container 3a08d522e0c393768c845fc69fd9aff342d137ae48ae91de52d9796190271c43: Status 404 returned error can't find the container with id 3a08d522e0c393768c845fc69fd9aff342d137ae48ae91de52d9796190271c43
May 28 19:49:56.431253 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:49:56.431212    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" event={"ID":"73a05271-d470-46c0-aaea-d08126619569","Type":"ContainerStarted","Data":"3a08d522e0c393768c845fc69fd9aff342d137ae48ae91de52d9796190271c43"}
May 28 19:50:00.406237 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:00.406207    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:50:01.450178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:01.450128    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" event={"ID":"73a05271-d470-46c0-aaea-d08126619569","Type":"ContainerStarted","Data":"ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d"}
May 28 19:50:01.450579 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:01.450280    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:50:01.474085 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:01.474036    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" podStartSLOduration=1.6952383210000002 podStartE2EDuration="6.474020955s" podCreationTimestamp="2026-05-28 19:49:55 +0000 UTC" firstStartedPulling="2026-05-28 19:49:55.665716248 +0000 UTC m=+377.271280657" lastFinishedPulling="2026-05-28 19:50:00.444498883 +0000 UTC m=+382.050063291" observedRunningTime="2026-05-28 19:50:01.471814122 +0000 UTC m=+383.077378542" watchObservedRunningTime="2026-05-28 19:50:01.474020955 +0000 UTC m=+383.079585386"
May 28 19:50:04.424047 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:04.424018    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bkv4k"
May 28 19:50:12.455859 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:12.455827    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:50:13.525275 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.525240    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"]
May 28 19:50:13.528935 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.528918    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.544299 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.544274    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"]
May 28 19:50:13.643178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.643130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.643178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.643171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqmc\" (UniqueName: \"kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.744760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.744727    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.744760 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.744766    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btqmc\" (UniqueName: \"kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.745224 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.745202    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.758150 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.758116    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqmc\" (UniqueName: \"kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.839017 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.838930    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:13.983915 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:13.983889    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"]
May 28 19:50:13.986043 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:13.986007    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063ef570_b5f3_43a8_bb38_9ace559cb161.slice/crio-52ce4ccd65ac3f00de66413ac64fe9ddce4afbe6027756fddefd7a577c09dab7 WatchSource:0}: Error finding container 52ce4ccd65ac3f00de66413ac64fe9ddce4afbe6027756fddefd7a577c09dab7: Status 404 returned error can't find the container with id 52ce4ccd65ac3f00de66413ac64fe9ddce4afbe6027756fddefd7a577c09dab7
May 28 19:50:14.200086 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.200051    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"]
May 28 19:50:14.200333 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.200309    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" podUID="73a05271-d470-46c0-aaea-d08126619569" containerName="manager" containerID="cri-o://ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d" gracePeriod=2
May 28 19:50:14.216424 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.216395    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"]
May 28 19:50:14.225751 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.225712    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:14.226561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.226387    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a05271-d470-46c0-aaea-d08126619569" containerName="manager"
May 28 19:50:14.226561 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.226411    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a05271-d470-46c0-aaea-d08126619569" containerName="manager"
May 28 19:50:14.226769 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.226598    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="73a05271-d470-46c0-aaea-d08126619569" containerName="manager"
May 28 19:50:14.229730 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.229710    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"]
May 28 19:50:14.229879 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.229851    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.232255 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.232224    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.243131 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.243039    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"]
May 28 19:50:14.245151 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.245114    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:14.255302 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.255269    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"]
May 28 19:50:14.256244 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.255885    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" containerName="manager" containerID="cri-o://f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691" gracePeriod=2
May 28 19:50:14.261453 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.261315    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.263189 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.263168    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:14.263555 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.263544    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" containerName="manager"
May 28 19:50:14.263598 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.263558    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" containerName="manager"
May 28 19:50:14.263642 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.263612    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" containerName="manager"
May 28 19:50:14.266852 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.266828    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.273558 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.273533    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"]
May 28 19:50:14.274385 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.274352    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.278464 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.278429    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.286831 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.286805    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:14.288291 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.288269    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"]
May 28 19:50:14.288664 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.288651    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" containerName="manager"
May 28 19:50:14.288709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.288666    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" containerName="manager"
May 28 19:50:14.288755 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.288745    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" containerName="manager"
May 28 19:50:14.291785 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.291767    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:14.303883 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.303851    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"]
May 28 19:50:14.305909 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.305742    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.327937 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.327906    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.351343 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.351301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqt2f\" (UniqueName: \"kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.351557 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.351363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7kzn\" (UniqueName: \"kubernetes.io/projected/e8cdb6d1-498a-4371-8e33-922ba0407e11-kube-api-access-p7kzn\") pod \"limitador-operator-controller-manager-85c4996f8c-qbckn\" (UID: \"e8cdb6d1-498a-4371-8e33-922ba0407e11\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:14.351557 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.351473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.351557 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.351533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.351685 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.351575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngkq6\" (UniqueName: \"kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.452530 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452448    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.452530 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452510    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngkq6\" (UniqueName: \"kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.452709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452568    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt2f\" (UniqueName: \"kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.452709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452631    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7kzn\" (UniqueName: \"kubernetes.io/projected/e8cdb6d1-498a-4371-8e33-922ba0407e11-kube-api-access-p7kzn\") pod \"limitador-operator-controller-manager-85c4996f8c-qbckn\" (UID: \"e8cdb6d1-498a-4371-8e33-922ba0407e11\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:14.452709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452691    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.452954 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.452930    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.453150 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.453132    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.461967 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.461931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7kzn\" (UniqueName: \"kubernetes.io/projected/e8cdb6d1-498a-4371-8e33-922ba0407e11-kube-api-access-p7kzn\") pod \"limitador-operator-controller-manager-85c4996f8c-qbckn\" (UID: \"e8cdb6d1-498a-4371-8e33-922ba0407e11\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:14.462192 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.462174    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqt2f\" (UniqueName: \"kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.462317 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.462297    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngkq6\" (UniqueName: \"kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fx48b\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.479145 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.479121    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:50:14.481745 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.481705    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.484283 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.484240    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.487255 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.487235    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:50:14.489486 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.489460    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.491406 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.491387    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.497292 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.497267    2564 generic.go:358] "Generic (PLEG): container finished" podID="73a05271-d470-46c0-aaea-d08126619569" containerID="ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d" exitCode=0
May 28 19:50:14.497408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.497311    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df"
May 28 19:50:14.497408 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.497356    2564 scope.go:117] "RemoveContainer" containerID="ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d"
May 28 19:50:14.499049 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:14.499032    2564 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" container="manager"
May 28 19:50:14.500033 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.500012    2564 generic.go:358] "Generic (PLEG): container finished" podID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" containerID="f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691" exitCode=0
May 28 19:50:14.500113 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.500048    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd"
May 28 19:50:14.500256 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.500235    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.502709 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.502683    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.505971 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.505944    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.507419 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.507395    2564 scope.go:117] "RemoveContainer" containerID="ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d"
May 28 19:50:14.507701 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:14.507679    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d\": container with ID starting with ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d not found: ID does not exist" containerID="ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d"
May 28 19:50:14.507784 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.507714    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d"} err="failed to get container status \"ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d\": rpc error: code = NotFound desc = could not find container \"ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d\": container with ID starting with ba46d7ebc55a5e24b19fbb86a9e042aa6903454005f1f2a44dbb28340dc8785d not found: ID does not exist"
May 28 19:50:14.507784 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.507736    2564 scope.go:117] "RemoveContainer" containerID="f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691"
May 28 19:50:14.508114 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.508087    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.510234 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.510204    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.515998 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.515981    2564 scope.go:117] "RemoveContainer" containerID="f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691"
May 28 19:50:14.516251 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:14.516233    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691\": container with ID starting with f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691 not found: ID does not exist" containerID="f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691"
May 28 19:50:14.516308 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.516259    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691"} err="failed to get container status \"f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691\": rpc error: code = NotFound desc = could not find container \"f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691\": container with ID starting with f27c9b06dc94247331613793a48783306f0e4d83a97eaf07a780309a9dbe6691 not found: ID does not exist"
May 28 19:50:14.553630 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.553592    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume\") pod \"73a05271-d470-46c0-aaea-d08126619569\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") "
May 28 19:50:14.554094 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.553653    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k97m4\" (UniqueName: \"kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4\") pod \"73a05271-d470-46c0-aaea-d08126619569\" (UID: \"73a05271-d470-46c0-aaea-d08126619569\") "
May 28 19:50:14.554094 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.553684    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cghvw\" (UniqueName: \"kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw\") pod \"a42b2ba4-b627-4d86-a99f-b2d26b721b90\" (UID: \"a42b2ba4-b627-4d86-a99f-b2d26b721b90\") "
May 28 19:50:14.554186 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.554132    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73a05271-d470-46c0-aaea-d08126619569" (UID: "73a05271-d470-46c0-aaea-d08126619569"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:50:14.555678 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.555650    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4" (OuterVolumeSpecName: "kube-api-access-k97m4") pod "73a05271-d470-46c0-aaea-d08126619569" (UID: "73a05271-d470-46c0-aaea-d08126619569"). InnerVolumeSpecName "kube-api-access-k97m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:50:14.555758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.555722    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw" (OuterVolumeSpecName: "kube-api-access-cghvw") pod "a42b2ba4-b627-4d86-a99f-b2d26b721b90" (UID: "a42b2ba4-b627-4d86-a99f-b2d26b721b90"). InnerVolumeSpecName "kube-api-access-cghvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:50:14.618226 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.618174    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:14.626126 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.626095    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:14.632923 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.632898    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:14.654948 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.654906    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73a05271-d470-46c0-aaea-d08126619569-extensions-socket-volume\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:14.654948 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.654952    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k97m4\" (UniqueName: \"kubernetes.io/projected/73a05271-d470-46c0-aaea-d08126619569-kube-api-access-k97m4\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:14.654948 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.654973    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cghvw\" (UniqueName: \"kubernetes.io/projected/a42b2ba4-b627-4d86-a99f-b2d26b721b90-kube-api-access-cghvw\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:14.772265 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.772231    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:14.776969 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:14.776937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582d6054_e2ea_4222_a8d7_f49518f7a607.slice/crio-c94ab1147c053f1557a556c225623c07376f8c6ff1b8356a210e90178df39274 WatchSource:0}: Error finding container c94ab1147c053f1557a556c225623c07376f8c6ff1b8356a210e90178df39274: Status 404 returned error can't find the container with id c94ab1147c053f1557a556c225623c07376f8c6ff1b8356a210e90178df39274
May 28 19:50:14.830390 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.830361    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.832397 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.832367    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.834296 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.834272    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.836130 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.836107    2564 status_manager.go:895] "Failed to get status for pod" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jljgd" err="pods \"limitador-operator-controller-manager-85c4996f8c-jljgd\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.837822 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.837781    2564 status_manager.go:895] "Failed to get status for pod" podUID="73a05271-d470-46c0-aaea-d08126619569" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8g8df" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8g8df\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.839673 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.839650    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:14.997555 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:14.997533    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:15.001007 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:15.000976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33975c98_03b1_4c6a_97ed_91c2bd8163fd.slice/crio-9ec7665fb251229af391b64d2570674b98bac64c636199457227e908ad6494f1 WatchSource:0}: Error finding container 9ec7665fb251229af391b64d2570674b98bac64c636199457227e908ad6494f1: Status 404 returned error can't find the container with id 9ec7665fb251229af391b64d2570674b98bac64c636199457227e908ad6494f1
May 28 19:50:15.002495 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.002470    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"]
May 28 19:50:15.004212 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:15.004182    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cdb6d1_498a_4371_8e33_922ba0407e11.slice/crio-33fb23669eff0d0291dcba73666968b4917de95eac4926e207b6ebe5ebd363ac WatchSource:0}: Error finding container 33fb23669eff0d0291dcba73666968b4917de95eac4926e207b6ebe5ebd363ac: Status 404 returned error can't find the container with id 33fb23669eff0d0291dcba73666968b4917de95eac4926e207b6ebe5ebd363ac
May 28 19:50:15.053720 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.053692    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a05271-d470-46c0-aaea-d08126619569" path="/var/lib/kubelet/pods/73a05271-d470-46c0-aaea-d08126619569/volumes"
May 28 19:50:15.054085 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.054070    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42b2ba4-b627-4d86-a99f-b2d26b721b90" path="/var/lib/kubelet/pods/a42b2ba4-b627-4d86-a99f-b2d26b721b90/volumes"
May 28 19:50:15.505399 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.505362    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn" event={"ID":"e8cdb6d1-498a-4371-8e33-922ba0407e11","Type":"ContainerStarted","Data":"3c77f630932fde8425601f6f750c579d3c05e762fe55a9eb63783ce2a5d9dcde"}
May 28 19:50:15.505399 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.505399    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn" event={"ID":"e8cdb6d1-498a-4371-8e33-922ba0407e11","Type":"ContainerStarted","Data":"33fb23669eff0d0291dcba73666968b4917de95eac4926e207b6ebe5ebd363ac"}
May 28 19:50:15.505725 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.505590    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:15.506747 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.506725    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" event={"ID":"33975c98-03b1-4c6a-97ed-91c2bd8163fd","Type":"ContainerStarted","Data":"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"}
May 28 19:50:15.506840 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.506752    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" event={"ID":"33975c98-03b1-4c6a-97ed-91c2bd8163fd","Type":"ContainerStarted","Data":"9ec7665fb251229af391b64d2570674b98bac64c636199457227e908ad6494f1"}
May 28 19:50:15.506893 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.506844    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:15.508880 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.508856    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" containerName="manager" containerID="cri-o://95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f" gracePeriod=2
May 28 19:50:15.510117 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.510097    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" event={"ID":"582d6054-e2ea-4222-a8d7-f49518f7a607","Type":"ContainerStarted","Data":"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"}
May 28 19:50:15.510227 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.510119    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" event={"ID":"582d6054-e2ea-4222-a8d7-f49518f7a607","Type":"ContainerStarted","Data":"c94ab1147c053f1557a556c225623c07376f8c6ff1b8356a210e90178df39274"}
May 28 19:50:15.510290 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.510239    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:15.533781 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.533736    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn" podStartSLOduration=1.533721915 podStartE2EDuration="1.533721915s" podCreationTimestamp="2026-05-28 19:50:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:50:15.531505315 +0000 UTC m=+397.137069783" watchObservedRunningTime="2026-05-28 19:50:15.533721915 +0000 UTC m=+397.139286345"
May 28 19:50:15.566391 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.566331    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" podStartSLOduration=1.566312498 podStartE2EDuration="1.566312498s" podCreationTimestamp="2026-05-28 19:50:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:50:15.563038962 +0000 UTC m=+397.168603392" watchObservedRunningTime="2026-05-28 19:50:15.566312498 +0000 UTC m=+397.171876928"
May 28 19:50:15.603170 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.603121    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" podStartSLOduration=1.603105022 podStartE2EDuration="1.603105022s" podCreationTimestamp="2026-05-28 19:50:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:50:15.600458836 +0000 UTC m=+397.206023265" watchObservedRunningTime="2026-05-28 19:50:15.603105022 +0000 UTC m=+397.208669454"
May 28 19:50:15.736135 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.736111    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:15.738863 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.738838    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:15.866649 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.866613    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume\") pod \"063ef570-b5f3-43a8-bb38-9ace559cb161\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") "
May 28 19:50:15.866789 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.866698    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btqmc\" (UniqueName: \"kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc\") pod \"063ef570-b5f3-43a8-bb38-9ace559cb161\" (UID: \"063ef570-b5f3-43a8-bb38-9ace559cb161\") "
May 28 19:50:15.866888 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.866866    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "063ef570-b5f3-43a8-bb38-9ace559cb161" (UID: "063ef570-b5f3-43a8-bb38-9ace559cb161"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:50:15.866960 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.866946    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/063ef570-b5f3-43a8-bb38-9ace559cb161-extensions-socket-volume\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:15.868675 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.868649    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc" (OuterVolumeSpecName: "kube-api-access-btqmc") pod "063ef570-b5f3-43a8-bb38-9ace559cb161" (UID: "063ef570-b5f3-43a8-bb38-9ace559cb161"). InnerVolumeSpecName "kube-api-access-btqmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:50:15.967637 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:15.967604    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btqmc\" (UniqueName: \"kubernetes.io/projected/063ef570-b5f3-43a8-bb38-9ace559cb161-kube-api-access-btqmc\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:16.514880 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.514842    2564 generic.go:358] "Generic (PLEG): container finished" podID="063ef570-b5f3-43a8-bb38-9ace559cb161" containerID="95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f" exitCode=2
May 28 19:50:16.515063 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.514892    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44"
May 28 19:50:16.515063 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.514948    2564 scope.go:117] "RemoveContainer" containerID="95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f"
May 28 19:50:16.523890 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.523865    2564 scope.go:117] "RemoveContainer" containerID="95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f"
May 28 19:50:16.524113 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:16.524095    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f\": container with ID starting with 95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f not found: ID does not exist" containerID="95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f"
May 28 19:50:16.524158 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.524123    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f"} err="failed to get container status \"95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f\": rpc error: code = NotFound desc = could not find container \"95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f\": container with ID starting with 95f6f530ede0d8bf66cd81d571d685c19970d94c88689ce5c390769d69a3e95f not found: ID does not exist"
May 28 19:50:16.525932 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.525911    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:16.533511 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:16.533488    2564 status_manager.go:895] "Failed to get status for pod" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4nl44" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4nl44\" is forbidden: User \"system:node:ip-10-0-138-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-195.ec2.internal' and this object"
May 28 19:50:17.052557 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:17.052525    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063ef570-b5f3-43a8-bb38-9ace559cb161" path="/var/lib/kubelet/pods/063ef570-b5f3-43a8-bb38-9ace559cb161/volumes"
May 28 19:50:26.517566 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.517535    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:26.518161 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.517594    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:26.518161 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.517621    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qbckn"
May 28 19:50:26.686257 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.686221    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:26.686723 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.686693    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" podUID="582d6054-e2ea-4222-a8d7-f49518f7a607" containerName="manager" containerID="cri-o://07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11" gracePeriod=10
May 28 19:50:26.936866 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.936841    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:26.959862 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.959833    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"]
May 28 19:50:26.960247 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.960234    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582d6054-e2ea-4222-a8d7-f49518f7a607" containerName="manager"
May 28 19:50:26.960292 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.960249    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="582d6054-e2ea-4222-a8d7-f49518f7a607" containerName="manager"
May 28 19:50:26.960326 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.960310    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="582d6054-e2ea-4222-a8d7-f49518f7a607" containerName="manager"
May 28 19:50:26.963508 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.963491    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:26.992054 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:26.991996    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"]
May 28 19:50:27.069997 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.069922    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngkq6\" (UniqueName: \"kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6\") pod \"582d6054-e2ea-4222-a8d7-f49518f7a607\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") "
May 28 19:50:27.069997 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.069992    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume\") pod \"582d6054-e2ea-4222-a8d7-f49518f7a607\" (UID: \"582d6054-e2ea-4222-a8d7-f49518f7a607\") "
May 28 19:50:27.070168 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.070122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9shq\" (UniqueName: \"kubernetes.io/projected/18610675-cb10-4dca-a418-b43dbaa951cc-kube-api-access-j9shq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.070213 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.070178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18610675-cb10-4dca-a418-b43dbaa951cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.070405 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.070381    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "582d6054-e2ea-4222-a8d7-f49518f7a607" (UID: "582d6054-e2ea-4222-a8d7-f49518f7a607"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:50:27.071999 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.071974    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6" (OuterVolumeSpecName: "kube-api-access-ngkq6") pod "582d6054-e2ea-4222-a8d7-f49518f7a607" (UID: "582d6054-e2ea-4222-a8d7-f49518f7a607"). InnerVolumeSpecName "kube-api-access-ngkq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:50:27.171306 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.171265    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9shq\" (UniqueName: \"kubernetes.io/projected/18610675-cb10-4dca-a418-b43dbaa951cc-kube-api-access-j9shq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.171489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.171360    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18610675-cb10-4dca-a418-b43dbaa951cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.171489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.171428    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/582d6054-e2ea-4222-a8d7-f49518f7a607-extensions-socket-volume\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:27.171489 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.171444    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngkq6\" (UniqueName: \"kubernetes.io/projected/582d6054-e2ea-4222-a8d7-f49518f7a607-kube-api-access-ngkq6\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:27.171742 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.171722    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18610675-cb10-4dca-a418-b43dbaa951cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.179283 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.179257    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9shq\" (UniqueName: \"kubernetes.io/projected/18610675-cb10-4dca-a418-b43dbaa951cc-kube-api-access-j9shq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4bclf\" (UID: \"18610675-cb10-4dca-a418-b43dbaa951cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.274172 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.274129    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.409163 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.409010    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"]
May 28 19:50:27.412153 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:27.412122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18610675_cb10_4dca_a418_b43dbaa951cc.slice/crio-19ef40b5ff25a96881ea5a61ae265273a590ed9d70d22c59512373817553bae5 WatchSource:0}: Error finding container 19ef40b5ff25a96881ea5a61ae265273a590ed9d70d22c59512373817553bae5: Status 404 returned error can't find the container with id 19ef40b5ff25a96881ea5a61ae265273a590ed9d70d22c59512373817553bae5
May 28 19:50:27.558056 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.558020    2564 generic.go:358] "Generic (PLEG): container finished" podID="582d6054-e2ea-4222-a8d7-f49518f7a607" containerID="07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11" exitCode=0
May 28 19:50:27.558491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.558099    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"
May 28 19:50:27.558491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.558097    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" event={"ID":"582d6054-e2ea-4222-a8d7-f49518f7a607","Type":"ContainerDied","Data":"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"}
May 28 19:50:27.558491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.558136    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b" event={"ID":"582d6054-e2ea-4222-a8d7-f49518f7a607","Type":"ContainerDied","Data":"c94ab1147c053f1557a556c225623c07376f8c6ff1b8356a210e90178df39274"}
May 28 19:50:27.558491 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.558152    2564 scope.go:117] "RemoveContainer" containerID="07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"
May 28 19:50:27.559710 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.559686    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf" event={"ID":"18610675-cb10-4dca-a418-b43dbaa951cc","Type":"ContainerStarted","Data":"867fe1d0ba85cf1f52df55ad1931d5ce3557332e64fd9ddeb4d9d94bd7bf3ee1"}
May 28 19:50:27.559826 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.559723    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf" event={"ID":"18610675-cb10-4dca-a418-b43dbaa951cc","Type":"ContainerStarted","Data":"19ef40b5ff25a96881ea5a61ae265273a590ed9d70d22c59512373817553bae5"}
May 28 19:50:27.559826 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.559745    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:27.566729 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.566713    2564 scope.go:117] "RemoveContainer" containerID="07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"
May 28 19:50:27.566980 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:27.566963    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11\": container with ID starting with 07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11 not found: ID does not exist" containerID="07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"
May 28 19:50:27.567040 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.566989    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11"} err="failed to get container status \"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11\": rpc error: code = NotFound desc = could not find container \"07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11\": container with ID starting with 07846919c9ea752a447d366b46328cce23fb0dabc539617a7cf0806f26972e11 not found: ID does not exist"
May 28 19:50:27.582643 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.582543    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf" podStartSLOduration=1.582529721 podStartE2EDuration="1.582529721s" podCreationTimestamp="2026-05-28 19:50:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:50:27.580592578 +0000 UTC m=+409.186157011" watchObservedRunningTime="2026-05-28 19:50:27.582529721 +0000 UTC m=+409.188094151"
May 28 19:50:27.595465 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.595439    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:27.606180 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:27.606155    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fx48b"]
May 28 19:50:29.051967 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:29.051939    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="582d6054-e2ea-4222-a8d7-f49518f7a607" path="/var/lib/kubelet/pods/582d6054-e2ea-4222-a8d7-f49518f7a607/volumes"
May 28 19:50:38.566822 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.566763    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4bclf"
May 28 19:50:38.618202 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.618168    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:38.618450 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.618411    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" podUID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" containerName="manager" containerID="cri-o://2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8" gracePeriod=10
May 28 19:50:38.860592 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.860570    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:38.982270 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.982244    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqt2f\" (UniqueName: \"kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f\") pod \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") "
May 28 19:50:38.982379 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.982350    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume\") pod \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\" (UID: \"33975c98-03b1-4c6a-97ed-91c2bd8163fd\") "
May 28 19:50:38.982671 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.982647    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33975c98-03b1-4c6a-97ed-91c2bd8163fd" (UID: "33975c98-03b1-4c6a-97ed-91c2bd8163fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:50:38.984193 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:38.984158    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f" (OuterVolumeSpecName: "kube-api-access-xqt2f") pod "33975c98-03b1-4c6a-97ed-91c2bd8163fd" (UID: "33975c98-03b1-4c6a-97ed-91c2bd8163fd"). InnerVolumeSpecName "kube-api-access-xqt2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:50:39.083131 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.083102    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqt2f\" (UniqueName: \"kubernetes.io/projected/33975c98-03b1-4c6a-97ed-91c2bd8163fd-kube-api-access-xqt2f\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:39.083131 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.083130    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33975c98-03b1-4c6a-97ed-91c2bd8163fd-extensions-socket-volume\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 19:50:39.602883 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.602846    2564 generic.go:358] "Generic (PLEG): container finished" podID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" containerID="2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8" exitCode=0
May 28 19:50:39.603372 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.602900    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" event={"ID":"33975c98-03b1-4c6a-97ed-91c2bd8163fd","Type":"ContainerDied","Data":"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"}
May 28 19:50:39.603372 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.602916    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"
May 28 19:50:39.603372 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.602935    2564 scope.go:117] "RemoveContainer" containerID="2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"
May 28 19:50:39.603372 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.602925    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv" event={"ID":"33975c98-03b1-4c6a-97ed-91c2bd8163fd","Type":"ContainerDied","Data":"9ec7665fb251229af391b64d2570674b98bac64c636199457227e908ad6494f1"}
May 28 19:50:39.611225 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.611200    2564 scope.go:117] "RemoveContainer" containerID="2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"
May 28 19:50:39.611524 ip-10-0-138-195 kubenswrapper[2564]: E0528 19:50:39.611505    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8\": container with ID starting with 2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8 not found: ID does not exist" containerID="2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"
May 28 19:50:39.611580 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.611543    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8"} err="failed to get container status \"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8\": rpc error: code = NotFound desc = could not find container \"2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8\": container with ID starting with 2d642f01b227197c4c28d62638802b0abd7930d5c190136ee2e0fb2efea072d8 not found: ID does not exist"
May 28 19:50:39.621468 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.621440    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:39.630361 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:39.630334    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v5hlv"]
May 28 19:50:41.051053 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:41.051023    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" path="/var/lib/kubelet/pods/33975c98-03b1-4c6a-97ed-91c2bd8163fd/volumes"
May 28 19:50:42.932067 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.932036    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"]
May 28 19:50:42.932575 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.932556    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" containerName="manager"
May 28 19:50:42.932656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.932580    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" containerName="manager"
May 28 19:50:42.932656 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.932642    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="33975c98-03b1-4c6a-97ed-91c2bd8163fd" containerName="manager"
May 28 19:50:42.936989 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.936968    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:42.939565 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.939539    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-96fp5\""
May 28 19:50:42.948758 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:42.948731    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"]
May 28 19:50:43.015166 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9w4q\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-kube-api-access-q9w4q\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015341 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015341 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015341 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015341 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015473 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015473 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015473 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea26afc-1556-400c-8f7c-1a208fbe413c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.015473 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.015431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116440 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116401    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116440 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116448    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116465    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116480    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea26afc-1556-400c-8f7c-1a208fbe413c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116503    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116534    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9w4q\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-kube-api-access-q9w4q\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116565    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116594    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.116695 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116618    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.117069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.116947    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.117069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.117011    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.117069 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.117061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.117211 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.117149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.117402 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.117379    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea26afc-1556-400c-8f7c-1a208fbe413c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.118926 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.118903    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.119098 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.119079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.124311 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.124292    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.124442 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.124426    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9w4q\" (UniqueName: \"kubernetes.io/projected/aea26afc-1556-400c-8f7c-1a208fbe413c-kube-api-access-q9w4q\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-mh54w\" (UID: \"aea26afc-1556-400c-8f7c-1a208fbe413c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.250885 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.250767    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:43.385786 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.385757    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"]
May 28 19:50:43.388399 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:43.388365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea26afc_1556_400c_8f7c_1a208fbe413c.slice/crio-17af6e8d035106aa902aee7a7c98d7621f7a300c288a520ef84ac2928be6ec58 WatchSource:0}: Error finding container 17af6e8d035106aa902aee7a7c98d7621f7a300c288a520ef84ac2928be6ec58: Status 404 returned error can't find the container with id 17af6e8d035106aa902aee7a7c98d7621f7a300c288a520ef84ac2928be6ec58
May 28 19:50:43.390468 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.390440    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:50:43.390570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.390501    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:50:43.390570 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.390530    2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 28 19:50:43.619784 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.619698    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w" event={"ID":"aea26afc-1556-400c-8f7c-1a208fbe413c","Type":"ContainerStarted","Data":"ce392f11929ea342a9f05fb3191066fbdab403a29312e27c438a7539bc009d29"}
May 28 19:50:43.619784 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.619735    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w" event={"ID":"aea26afc-1556-400c-8f7c-1a208fbe413c","Type":"ContainerStarted","Data":"17af6e8d035106aa902aee7a7c98d7621f7a300c288a520ef84ac2928be6ec58"}
May 28 19:50:43.641811 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:43.641741    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w" podStartSLOduration=1.641723926 podStartE2EDuration="1.641723926s" podCreationTimestamp="2026-05-28 19:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:50:43.640922447 +0000 UTC m=+425.246486877" watchObservedRunningTime="2026-05-28 19:50:43.641723926 +0000 UTC m=+425.247288357"
May 28 19:50:44.251286 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:44.251251    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:44.256438 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:44.256411    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:44.624253 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:44.624172    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:44.625166 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:44.625150    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-mh54w"
May 28 19:50:57.236516 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.236419    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 19:50:57.240178 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.240156    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.242444 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.242424    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gh5fm\""
May 28 19:50:57.242551 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.242426    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 19:50:57.249513 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.249482    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 19:50:57.304549 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.304511    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 19:50:57.334963 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.334916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-config-file\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.335208 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.335063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8mdw\" (UniqueName: \"kubernetes.io/projected/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-kube-api-access-c8mdw\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.436042 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.436007    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8mdw\" (UniqueName: \"kubernetes.io/projected/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-kube-api-access-c8mdw\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.436221 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.436161    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-config-file\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.436769 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.436749    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-config-file\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.444573 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.444537    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8mdw\" (UniqueName: \"kubernetes.io/projected/a24f555b-1f2f-48af-a4b9-3eb0df4e269d-kube-api-access-c8mdw\") pod \"limitador-limitador-78c99df468-c77tj\" (UID: \"a24f555b-1f2f-48af-a4b9-3eb0df4e269d\") " pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.552208 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.552116    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:50:57.689699 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:57.689671    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 19:50:57.692196 ip-10-0-138-195 kubenswrapper[2564]: W0528 19:50:57.692163    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24f555b_1f2f_48af_a4b9_3eb0df4e269d.slice/crio-2eea8a35297276ed7a5074fee6bce95739e02a86fee6fbf04d0ee44986f81436 WatchSource:0}: Error finding container 2eea8a35297276ed7a5074fee6bce95739e02a86fee6fbf04d0ee44986f81436: Status 404 returned error can't find the container with id 2eea8a35297276ed7a5074fee6bce95739e02a86fee6fbf04d0ee44986f81436
May 28 19:50:58.673412 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:50:58.673379    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj" event={"ID":"a24f555b-1f2f-48af-a4b9-3eb0df4e269d","Type":"ContainerStarted","Data":"2eea8a35297276ed7a5074fee6bce95739e02a86fee6fbf04d0ee44986f81436"}
May 28 19:51:00.682373 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:51:00.682329    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj" event={"ID":"a24f555b-1f2f-48af-a4b9-3eb0df4e269d","Type":"ContainerStarted","Data":"033e87b1cbf1ce1678be1dae95e28a55d822805b48cad71c1c4842093ca36ba7"}
May 28 19:51:00.682775 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:51:00.682404    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:51:00.701300 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:51:00.701241    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj" podStartSLOduration=1.230833977 podStartE2EDuration="3.701228319s" podCreationTimestamp="2026-05-28 19:50:57 +0000 UTC" firstStartedPulling="2026-05-28 19:50:57.695059664 +0000 UTC m=+439.300624071" lastFinishedPulling="2026-05-28 19:51:00.165454002 +0000 UTC m=+441.771018413" observedRunningTime="2026-05-28 19:51:00.699582849 +0000 UTC m=+442.305147304" watchObservedRunningTime="2026-05-28 19:51:00.701228319 +0000 UTC m=+442.306792749"
May 28 19:51:11.686820 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:51:11.686761    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-c77tj"
May 28 19:52:06.738541 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:52:06.738504    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 19:53:38.946634 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:53:38.946603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:53:38.947786 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:53:38.947768    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:58:38.974284 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:58:38.974208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 19:58:38.976956 ip-10-0-138-195 kubenswrapper[2564]: I0528 19:58:38.976931    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:00:16.012079 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.012043    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76dcdb64cf-grzmz"]
May 28 20:00:16.015606 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.015586    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.023627 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.023600    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dcdb64cf-grzmz"]
May 28 20:00:16.115268 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-service-ca\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115444 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-oauth-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115444 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115444 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x777\" (UniqueName: \"kubernetes.io/projected/6bab8231-96fe-4ea9-81a3-73dce230b1c5-kube-api-access-6x777\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115444 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115598 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-oauth-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.115598 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.115503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-trusted-ca-bundle\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216421 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216389    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216421 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216437    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x777\" (UniqueName: \"kubernetes.io/projected/6bab8231-96fe-4ea9-81a3-73dce230b1c5-kube-api-access-6x777\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216531    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216554    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-oauth-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216573    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-trusted-ca-bundle\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216603    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-service-ca\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.216919 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.216633    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-oauth-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.217230 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.217196    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.217363 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.217294    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-service-ca\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.217430 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.217369    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-oauth-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.217508 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.217477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bab8231-96fe-4ea9-81a3-73dce230b1c5-trusted-ca-bundle\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.219085 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.219063    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-serving-cert\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.219403 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.219385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bab8231-96fe-4ea9-81a3-73dce230b1c5-console-oauth-config\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.224872 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.224849    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x777\" (UniqueName: \"kubernetes.io/projected/6bab8231-96fe-4ea9-81a3-73dce230b1c5-kube-api-access-6x777\") pod \"console-76dcdb64cf-grzmz\" (UID: \"6bab8231-96fe-4ea9-81a3-73dce230b1c5\") " pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.326108 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.326026    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:16.458431 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.458405    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dcdb64cf-grzmz"]
May 28 20:00:16.460602 ip-10-0-138-195 kubenswrapper[2564]: W0528 20:00:16.460576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bab8231_96fe_4ea9_81a3_73dce230b1c5.slice/crio-c7ba6e889df9bcd919082d77908b38ed5723cfa95f2ed8d1d53275ccfe920a8b WatchSource:0}: Error finding container c7ba6e889df9bcd919082d77908b38ed5723cfa95f2ed8d1d53275ccfe920a8b: Status 404 returned error can't find the container with id c7ba6e889df9bcd919082d77908b38ed5723cfa95f2ed8d1d53275ccfe920a8b
May 28 20:00:16.462421 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.462400    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:00:16.625931 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.625855    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dcdb64cf-grzmz" event={"ID":"6bab8231-96fe-4ea9-81a3-73dce230b1c5","Type":"ContainerStarted","Data":"ff8ee19e89b9490debe5f9d837eee344eabedda439275569761b9295751ade6f"}
May 28 20:00:16.625931 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.625889    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dcdb64cf-grzmz" event={"ID":"6bab8231-96fe-4ea9-81a3-73dce230b1c5","Type":"ContainerStarted","Data":"c7ba6e889df9bcd919082d77908b38ed5723cfa95f2ed8d1d53275ccfe920a8b"}
May 28 20:00:16.647443 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:16.647400    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76dcdb64cf-grzmz" podStartSLOduration=1.647385042 podStartE2EDuration="1.647385042s" podCreationTimestamp="2026-05-28 20:00:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:00:16.64535298 +0000 UTC m=+998.250917409" watchObservedRunningTime="2026-05-28 20:00:16.647385042 +0000 UTC m=+998.252949471"
May 28 20:00:26.326921 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:26.326881    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:26.326921 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:26.326925    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:26.332421 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:26.332395    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:26.664964 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:26.664933    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76dcdb64cf-grzmz"
May 28 20:00:26.712109 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:26.712076    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 20:00:51.731613 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:51.731574    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9df697855-z7zmh" podUID="04ce81bb-af5f-474e-bd41-469a06eba930" containerName="console" containerID="cri-o://c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524" gracePeriod=15
May 28 20:00:51.973687 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:51.973666    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9df697855-z7zmh_04ce81bb-af5f-474e-bd41-469a06eba930/console/0.log"
May 28 20:00:51.973809 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:51.973725    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9df697855-z7zmh"
May 28 20:00:52.027307 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027231    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027307 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027279    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhgf\" (UniqueName: \"kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027482 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027313    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027482 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027406    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027482 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027430    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027482 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027476    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027660 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027545    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert\") pod \"04ce81bb-af5f-474e-bd41-469a06eba930\" (UID: \"04ce81bb-af5f-474e-bd41-469a06eba930\") "
May 28 20:00:52.027660 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027643    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca" (OuterVolumeSpecName: "service-ca") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:00:52.027967 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027922    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config" (OuterVolumeSpecName: "console-config") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:00:52.027967 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027930    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:00:52.028122 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.027972    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 20:00:52.028122 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.028018    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-service-ca\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.029622 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.029599    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:00:52.029709 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.029643    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf" (OuterVolumeSpecName: "kube-api-access-fmhgf") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "kube-api-access-fmhgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:00:52.029709 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.029659    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04ce81bb-af5f-474e-bd41-469a06eba930" (UID: "04ce81bb-af5f-474e-bd41-469a06eba930"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:00:52.129351 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129296    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.129351 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129345    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhgf\" (UniqueName: \"kubernetes.io/projected/04ce81bb-af5f-474e-bd41-469a06eba930-kube-api-access-fmhgf\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.129351 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129361    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04ce81bb-af5f-474e-bd41-469a06eba930-console-oauth-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.129605 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129374    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-trusted-ca-bundle\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.129605 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129387    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-console-config\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.129605 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.129399    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04ce81bb-af5f-474e-bd41-469a06eba930-oauth-serving-cert\") on node \"ip-10-0-138-195.ec2.internal\" DevicePath \"\""
May 28 20:00:52.752194 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9df697855-z7zmh_04ce81bb-af5f-474e-bd41-469a06eba930/console/0.log"
May 28 20:00:52.752584 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752211    2564 generic.go:358] "Generic (PLEG): container finished" podID="04ce81bb-af5f-474e-bd41-469a06eba930" containerID="c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524" exitCode=2
May 28 20:00:52.752584 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752265    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9df697855-z7zmh" event={"ID":"04ce81bb-af5f-474e-bd41-469a06eba930","Type":"ContainerDied","Data":"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"}
May 28 20:00:52.752584 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752295    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9df697855-z7zmh" event={"ID":"04ce81bb-af5f-474e-bd41-469a06eba930","Type":"ContainerDied","Data":"2bb519c05b17f5ea93ea9fc560757e6d726f8b71b2f686859e78cab56f14d819"}
May 28 20:00:52.752584 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752316    2564 scope.go:117] "RemoveContainer" containerID="c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"
May 28 20:00:52.752584 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.752318    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9df697855-z7zmh"
May 28 20:00:52.760997 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.760982    2564 scope.go:117] "RemoveContainer" containerID="c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"
May 28 20:00:52.761235 ip-10-0-138-195 kubenswrapper[2564]: E0528 20:00:52.761215    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524\": container with ID starting with c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524 not found: ID does not exist" containerID="c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"
May 28 20:00:52.761300 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.761248    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524"} err="failed to get container status \"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524\": rpc error: code = NotFound desc = could not find container \"c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524\": container with ID starting with c660cead800079b579dfc0dfcd1f903cf8e6d9bf255da74fae1c87d86aedb524 not found: ID does not exist"
May 28 20:00:52.775458 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.775436    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 20:00:52.779865 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:52.779841    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9df697855-z7zmh"]
May 28 20:00:53.051497 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:00:53.051425    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ce81bb-af5f-474e-bd41-469a06eba930" path="/var/lib/kubelet/pods/04ce81bb-af5f-474e-bd41-469a06eba930/volumes"
May 28 20:03:38.999434 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:03:38.999405    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:03:39.002218 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:03:39.002188    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:08:39.026131 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:08:39.026097    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:08:39.030096 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:08:39.030078    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:12:08.144842 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:08.142377    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:12:11.344175 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:11.344142    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:12:19.851820 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:19.851774    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:12:22.398996 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:22.398958    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:12:29.446672 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.446634    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"]
May 28 20:12:29.447118 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.447063    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ce81bb-af5f-474e-bd41-469a06eba930" containerName="console"
May 28 20:12:29.447118 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.447076    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ce81bb-af5f-474e-bd41-469a06eba930" containerName="console"
May 28 20:12:29.447204 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.447163    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="04ce81bb-af5f-474e-bd41-469a06eba930" containerName="console"
May 28 20:12:29.450781 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.450759    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.454368 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.454347    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqc2b\""
May 28 20:12:29.454480 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.454373    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 20:12:29.454480 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.454375    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 20:12:29.454480 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.454349    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 20:12:29.461783 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.461757    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"]
May 28 20:12:29.532280 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.532506 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.532647 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.532711 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.532763 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.532851 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.532760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrg9f\" (UniqueName: \"kubernetes.io/projected/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kube-api-access-zrg9f\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.633677 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633638    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.633677 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633682    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.633910 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.633910 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633872    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrg9f\" (UniqueName: \"kubernetes.io/projected/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kube-api-access-zrg9f\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.633986 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633918    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.634044 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.633991    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.634101 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.634061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.634177 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.634153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.634348 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.634330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.636079 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.636058    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.636236 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.636217    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.659933 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.659904    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrg9f\" (UniqueName: \"kubernetes.io/projected/ed2f6b6f-1de0-4b49-9ce9-560033e152c1-kube-api-access-zrg9f\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg\" (UID: \"ed2f6b6f-1de0-4b49-9ce9-560033e152c1\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.762186 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.762092    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:29.913358 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.913322    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"]
May 28 20:12:29.916433 ip-10-0-138-195 kubenswrapper[2564]: W0528 20:12:29.916401    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2f6b6f_1de0_4b49_9ce9_560033e152c1.slice/crio-ad9a544b898cb487186d0ed852f063ad94ed85d18409f755f12bc07165397249 WatchSource:0}: Error finding container ad9a544b898cb487186d0ed852f063ad94ed85d18409f755f12bc07165397249: Status 404 returned error can't find the container with id ad9a544b898cb487186d0ed852f063ad94ed85d18409f755f12bc07165397249
May 28 20:12:29.918028 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:29.918014    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:12:30.206659 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:30.206622    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg" event={"ID":"ed2f6b6f-1de0-4b49-9ce9-560033e152c1","Type":"ContainerStarted","Data":"ad9a544b898cb487186d0ed852f063ad94ed85d18409f755f12bc07165397249"}
May 28 20:12:30.753328 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:30.753295    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:12:36.233926 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:36.233890    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg" event={"ID":"ed2f6b6f-1de0-4b49-9ce9-560033e152c1","Type":"ContainerStarted","Data":"a7c62e99f1d9d9311832621d69fac2c8068652c13ed9a1eaf9a1e56042e30747"}
May 28 20:12:42.256900 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:42.256864    2564 generic.go:358] "Generic (PLEG): container finished" podID="ed2f6b6f-1de0-4b49-9ce9-560033e152c1" containerID="a7c62e99f1d9d9311832621d69fac2c8068652c13ed9a1eaf9a1e56042e30747" exitCode=0
May 28 20:12:42.257346 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:42.256933    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg" event={"ID":"ed2f6b6f-1de0-4b49-9ce9-560033e152c1","Type":"ContainerDied","Data":"a7c62e99f1d9d9311832621d69fac2c8068652c13ed9a1eaf9a1e56042e30747"}
May 28 20:12:44.270105 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:44.270066    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg" event={"ID":"ed2f6b6f-1de0-4b49-9ce9-560033e152c1","Type":"ContainerStarted","Data":"29dd910fe2abf7b2542fc755cea25c22fcfadcc69093de51f2db783efcf3e3c4"}
May 28 20:12:44.270591 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:44.270298    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:12:44.306531 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:44.306471    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg" podStartSLOduration=1.7822798469999999 podStartE2EDuration="15.306453187s" podCreationTimestamp="2026-05-28 20:12:29 +0000 UTC" firstStartedPulling="2026-05-28 20:12:29.918135684 +0000 UTC m=+1731.523700091" lastFinishedPulling="2026-05-28 20:12:43.442308967 +0000 UTC m=+1745.047873431" observedRunningTime="2026-05-28 20:12:44.304578967 +0000 UTC m=+1745.910143409" watchObservedRunningTime="2026-05-28 20:12:44.306453187 +0000 UTC m=+1745.912017626"
May 28 20:12:55.286929 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:12:55.286895    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg"
May 28 20:13:02.105578 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:13:02.105541    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-c77tj"]
May 28 20:13:39.057283 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:13:39.057166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:13:39.062301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:13:39.062280    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:15:18.462964 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:18.462926    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69568b6749-qd5vl_a32f1b69-3646-465e-9553-67df766a6890/manager/0.log"
May 28 20:15:19.967849 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:19.967819    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bkv4k_e88d672c-9e3e-46f2-aa33-8a827a0c239d/manager/0.log"
May 28 20:15:20.191282 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:20.191250    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b9kd8_11d9c48f-819c-4640-b46e-c2b3d362c3f7/registry-server/0.log"
May 28 20:15:20.313438 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:20.313337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-4bclf_18610675-cb10-4dca-a418-b43dbaa951cc/manager/0.log"
May 28 20:15:20.416114 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:20.416081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-c77tj_a24f555b-1f2f-48af-a4b9-3eb0df4e269d/limitador/0.log"
May 28 20:15:20.523445 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:20.523412    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qbckn_e8cdb6d1-498a-4371-8e33-922ba0407e11/manager/0.log"
May 28 20:15:20.853593 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:20.853561    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h_49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01/istio-proxy/0.log"
May 28 20:15:21.284292 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:21.284263    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mh54w_aea26afc-1556-400c-8f7c-1a208fbe413c/istio-proxy/0.log"
May 28 20:15:21.929074 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:21.929043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg_ed2f6b6f-1de0-4b49-9ce9-560033e152c1/storage-initializer/0.log"
May 28 20:15:21.936074 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:21.936048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-stmzg_ed2f6b6f-1de0-4b49-9ce9-560033e152c1/main/0.log"
May 28 20:15:29.730264 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:29.730230    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jpkhg_517a8bc4-e5e9-48cc-8439-64b492e5f0b2/global-pull-secret-syncer/0.log"
May 28 20:15:29.906607 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:29.906573    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zv5sb_1a7cfc36-1bee-41de-9d1b-a29eb66a259b/konnectivity-agent/0.log"
May 28 20:15:29.958237 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:29.958196    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-195.ec2.internal_4bae7945d9afb3043257c8a7ddde8e4a/haproxy/0.log"
May 28 20:15:33.577325 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:33.577236    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bkv4k_e88d672c-9e3e-46f2-aa33-8a827a0c239d/manager/0.log"
May 28 20:15:33.642212 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:33.642183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b9kd8_11d9c48f-819c-4640-b46e-c2b3d362c3f7/registry-server/0.log"
May 28 20:15:33.691354 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:33.691299    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-4bclf_18610675-cb10-4dca-a418-b43dbaa951cc/manager/0.log"
May 28 20:15:33.710715 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:33.710687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-c77tj_a24f555b-1f2f-48af-a4b9-3eb0df4e269d/limitador/0.log"
May 28 20:15:33.743909 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:33.743874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qbckn_e8cdb6d1-498a-4371-8e33-922ba0407e11/manager/0.log"
May 28 20:15:34.913405 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:34.913375    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/alertmanager/0.log"
May 28 20:15:34.938042 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:34.938011    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/config-reloader/0.log"
May 28 20:15:34.956909 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:34.956875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/kube-rbac-proxy-web/0.log"
May 28 20:15:34.978238 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:34.978193    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/kube-rbac-proxy/0.log"
May 28 20:15:34.997576 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:34.997545    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/kube-rbac-proxy-metric/0.log"
May 28 20:15:35.016290 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.016260    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/prom-label-proxy/0.log"
May 28 20:15:35.035328 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.035269    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f52637a8-0a00-4f10-8e07-6821b8e29095/init-config-reloader/0.log"
May 28 20:15:35.097755 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.097713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ndkzz_3d0441e7-9dff-424a-9d67-8531795090ef/kube-state-metrics/0.log"
May 28 20:15:35.111187 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.111163    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ndkzz_3d0441e7-9dff-424a-9d67-8531795090ef/kube-rbac-proxy-main/0.log"
May 28 20:15:35.132005 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.131966    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ndkzz_3d0441e7-9dff-424a-9d67-8531795090ef/kube-rbac-proxy-self/0.log"
May 28 20:15:35.319990 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.319962    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggtpt_7b19a241-0516-4342-a24d-49aee3d367a6/node-exporter/0.log"
May 28 20:15:35.338708 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.338677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggtpt_7b19a241-0516-4342-a24d-49aee3d367a6/kube-rbac-proxy/0.log"
May 28 20:15:35.359270 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.359241    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggtpt_7b19a241-0516-4342-a24d-49aee3d367a6/init-textfile/0.log"
May 28 20:15:35.467650 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.467570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-49klv_c189b147-1c12-44dd-baa4-5c5ff4f1aea1/kube-rbac-proxy-main/0.log"
May 28 20:15:35.487680 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.487646    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-49klv_c189b147-1c12-44dd-baa4-5c5ff4f1aea1/kube-rbac-proxy-self/0.log"
May 28 20:15:35.516631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.516608    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-49klv_c189b147-1c12-44dd-baa4-5c5ff4f1aea1/openshift-state-metrics/0.log"
May 28 20:15:35.571999 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.571960    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/prometheus/0.log"
May 28 20:15:35.596351 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.596328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/config-reloader/0.log"
May 28 20:15:35.616291 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.616267    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/thanos-sidecar/0.log"
May 28 20:15:35.638736 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.638704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/kube-rbac-proxy-web/0.log"
May 28 20:15:35.663751 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.663717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/kube-rbac-proxy/0.log"
May 28 20:15:35.687935 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.687908    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/kube-rbac-proxy-thanos/0.log"
May 28 20:15:35.708296 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.708275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c70e2f1-6453-47cc-81c6-acbee8f3d21b/init-config-reloader/0.log"
May 28 20:15:35.737822 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.737703    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-brbxt_ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6/prometheus-operator/0.log"
May 28 20:15:35.752731 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.752707    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-brbxt_ebcebd68-6b7a-4d36-b4e6-d8feeec27ed6/kube-rbac-proxy/0.log"
May 28 20:15:35.812112 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.812081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756dc5758b-grmnp_1120374d-213b-4cbb-9da2-21b2af823de3/telemeter-client/0.log"
May 28 20:15:35.834904 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.834873    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756dc5758b-grmnp_1120374d-213b-4cbb-9da2-21b2af823de3/reload/0.log"
May 28 20:15:35.856564 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.856531    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756dc5758b-grmnp_1120374d-213b-4cbb-9da2-21b2af823de3/kube-rbac-proxy/0.log"
May 28 20:15:35.885035 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.885005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/thanos-query/0.log"
May 28 20:15:35.908879 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.908838    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/kube-rbac-proxy-web/0.log"
May 28 20:15:35.927829 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.927764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/kube-rbac-proxy/0.log"
May 28 20:15:35.945460 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.945435    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/prom-label-proxy/0.log"
May 28 20:15:35.965115 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.965075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/kube-rbac-proxy-rules/0.log"
May 28 20:15:35.988716 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:35.988644    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b77b6746d-5ztwc_c9c876c1-69f2-4fe7-8291-fbe3849c1ebc/kube-rbac-proxy-metrics/0.log"
May 28 20:15:38.207121 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.207083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76dcdb64cf-grzmz_6bab8231-96fe-4ea9-81a3-73dce230b1c5/console/0.log"
May 28 20:15:38.692470 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.692435    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"]
May 28 20:15:38.695120 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.695097    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.697294 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.697277    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74sxj\"/\"kube-root-ca.crt\""
May 28 20:15:38.698268 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.698252    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74sxj\"/\"openshift-service-ca.crt\""
May 28 20:15:38.698320 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.698254    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74sxj\"/\"default-dockercfg-tqdrh\""
May 28 20:15:38.702638 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.702572    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"]
May 28 20:15:38.769631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.769594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-lib-modules\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.769631 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.769635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-podres\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.769864 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.769741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42t6\" (UniqueName: \"kubernetes.io/projected/4e39cf00-8797-4b34-a296-0fb5d618aa8e-kube-api-access-s42t6\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.769864 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.769769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-sys\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.769864 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.769813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-proc\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871042 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871005    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-lib-modules\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871042 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871047    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-podres\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s42t6\" (UniqueName: \"kubernetes.io/projected/4e39cf00-8797-4b34-a296-0fb5d618aa8e-kube-api-access-s42t6\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871114    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-sys\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871133    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-proc\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871185    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-lib-modules\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871238    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-sys\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871247    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-proc\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.871301 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.871250    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e39cf00-8797-4b34-a296-0fb5d618aa8e-podres\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:38.878495 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:38.878466    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42t6\" (UniqueName: \"kubernetes.io/projected/4e39cf00-8797-4b34-a296-0fb5d618aa8e-kube-api-access-s42t6\") pod \"perf-node-gather-daemonset-kwjbj\" (UID: \"4e39cf00-8797-4b34-a296-0fb5d618aa8e\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:39.009541 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.009454    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74sxj\"/\"default-dockercfg-tqdrh\""
May 28 20:15:39.017097 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.017073    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:39.152642 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.152614    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"]
May 28 20:15:39.155158 ip-10-0-138-195 kubenswrapper[2564]: W0528 20:15:39.155128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e39cf00_8797_4b34_a296_0fb5d618aa8e.slice/crio-ae6629b7494b99bc5b0ffe9d62c690767be860d63000dae5ac97f473de190666 WatchSource:0}: Error finding container ae6629b7494b99bc5b0ffe9d62c690767be860d63000dae5ac97f473de190666: Status 404 returned error can't find the container with id ae6629b7494b99bc5b0ffe9d62c690767be860d63000dae5ac97f473de190666
May 28 20:15:39.767992 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.767964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t48tq_c2f2f9f1-44b8-4bf7-87d6-612960b21c5a/dns/0.log"
May 28 20:15:39.786649 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.786619    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t48tq_c2f2f9f1-44b8-4bf7-87d6-612960b21c5a/kube-rbac-proxy/0.log"
May 28 20:15:39.849047 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.849011    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whhhh_a73816e2-4fe3-46a9-b270-0d801e18be88/dns-node-resolver/0.log"
May 28 20:15:39.892423 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.892382    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj" event={"ID":"4e39cf00-8797-4b34-a296-0fb5d618aa8e","Type":"ContainerStarted","Data":"b865aac65f0aa2889f22fb84d5ca1c1aa28a3f9c927e0d9c119e6aead908a80d"}
May 28 20:15:39.892423 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.892426    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj" event={"ID":"4e39cf00-8797-4b34-a296-0fb5d618aa8e","Type":"ContainerStarted","Data":"ae6629b7494b99bc5b0ffe9d62c690767be860d63000dae5ac97f473de190666"}
May 28 20:15:39.892678 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.892474    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:39.910054 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:39.910008    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj" podStartSLOduration=1.9099950350000001 podStartE2EDuration="1.909995035s" podCreationTimestamp="2026-05-28 20:15:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:15:39.907387314 +0000 UTC m=+1921.512951744" watchObservedRunningTime="2026-05-28 20:15:39.909995035 +0000 UTC m=+1921.515559465"
May 28 20:15:40.379243 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:40.379211    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gmtpj_2c20ffc6-c827-4512-98b9-0e2b2732d4c5/node-ca/0.log"
May 28 20:15:41.213305 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:41.213270    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bhlc7h_49dcf28f-7fcb-4fcb-b5b7-87564b8b3b01/istio-proxy/0.log"
May 28 20:15:41.378165 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:41.378134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-mh54w_aea26afc-1556-400c-8f7c-1a208fbe413c/istio-proxy/0.log"
May 28 20:15:41.975980 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:41.975941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5tnv_484bf113-6195-49a0-8aec-83ec8999522e/serve-healthcheck-canary/0.log"
May 28 20:15:42.609403 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:42.609372    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z574s_a67e8328-2f24-414e-91c3-618d5da4d522/kube-rbac-proxy/0.log"
May 28 20:15:42.636558 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:42.636529    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z574s_a67e8328-2f24-414e-91c3-618d5da4d522/exporter/0.log"
May 28 20:15:42.677672 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:42.677609    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z574s_a67e8328-2f24-414e-91c3-618d5da4d522/extractor/0.log"
May 28 20:15:44.595171 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:44.595141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69568b6749-qd5vl_a32f1b69-3646-465e-9553-67df766a6890/manager/0.log"
May 28 20:15:45.682610 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:45.682584    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9cd786b7b-j5zwk_4130a110-298e-4a1a-9ec4-6d98d7744883/manager/0.log"
May 28 20:15:45.905475 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:45.905450    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-kwjbj"
May 28 20:15:51.500234 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.500209    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/kube-multus-additional-cni-plugins/0.log"
May 28 20:15:51.523702 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.523671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/egress-router-binary-copy/0.log"
May 28 20:15:51.544116 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.544091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/cni-plugins/0.log"
May 28 20:15:51.561623 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.561579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/bond-cni-plugin/0.log"
May 28 20:15:51.579225 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.579201    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/routeoverride-cni/0.log"
May 28 20:15:51.596058 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.596037    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/whereabouts-cni-bincopy/0.log"
May 28 20:15:51.614180 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.614153    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8bjr_936095d3-eb33-4ba7-942b-07a94ea181c2/whereabouts-cni/0.log"
May 28 20:15:51.844566 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.844490    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zlz8q_b025fccc-b142-4d16-aa59-d884fbaf8949/kube-multus/0.log"
May 28 20:15:51.902234 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.902203    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h5fjp_13055ac8-d738-4e60-80d2-c2774a5dafd4/network-metrics-daemon/0.log"
May 28 20:15:51.917209 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:51.917184    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h5fjp_13055ac8-d738-4e60-80d2-c2774a5dafd4/kube-rbac-proxy/0.log"
May 28 20:15:53.266653 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.266624    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-controller/0.log"
May 28 20:15:53.284710 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.284677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/0.log"
May 28 20:15:53.302564 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.302534    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovn-acl-logging/1.log"
May 28 20:15:53.320298 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.320259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/kube-rbac-proxy-node/0.log"
May 28 20:15:53.339163 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.339138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/kube-rbac-proxy-ovn-metrics/0.log"
May 28 20:15:53.368748 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.368719    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/northd/0.log"
May 28 20:15:53.387452 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.387429    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/nbdb/0.log"
May 28 20:15:53.406395 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.406368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/sbdb/0.log"
May 28 20:15:53.585504 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:53.585421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8gl6_f2db3f0f-90d3-47f2-a4aa-75d8d7482b55/ovnkube-controller/0.log"
May 28 20:15:54.656330 ip-10-0-138-195 kubenswrapper[2564]: I0528 20:15:54.656302    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mpkxr_4b732133-b5a5-4092-8aaf-8a90b7bcd410/network-check-target-container/0.log"