May 28 17:17:48.487237 ip-10-0-128-101 systemd[1]: Starting Kubernetes Kubelet...
May 28 17:17:48.996193 ip-10-0-128-101 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:48.996193 ip-10-0-128-101 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 17:17:48.996193 ip-10-0-128-101 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:48.996193 ip-10-0-128-101 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 17:17:48.996193 ip-10-0-128-101 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:17:48.999334 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:48.999245    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 17:17:49.003251 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003235    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:49.003251 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003252    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003256    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003259    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003262    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003265    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003268    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003271    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003274    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003276    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003279    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003282    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003284    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003292    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003295    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003297    2558 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003301    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003304    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003306    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003309    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:49.003319 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003312    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003315    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003318    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003320    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003323    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003326    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003329    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003332    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003335    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003338    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003340    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003343    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003346    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003349    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003352    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003355    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003357    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003360    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003362    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:49.003797 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003365    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003369    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003373    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003376    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003379    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003382    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003385    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003387    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003389    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003392    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003394    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003397    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003400    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003402    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003404    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003408    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003411    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003413    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003416    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:49.004284 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003419    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003422    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003424    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003427    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003429    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003432    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003435    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003437    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003440    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003443    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003447    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003450    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003453    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003456    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003458    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003461    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003463    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003466    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003468    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:49.004849 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003471    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003473    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003475    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003478    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003480    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003483    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003485    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003489    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003491    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003889    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003894    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003897    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003900    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003903    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003905    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003908    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003911    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003914    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003916    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003933    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:49.005329 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003936    2558 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003939    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003942    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003944    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003947    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003950    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003953    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003955    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003958    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003960    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003963    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003966    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003968    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003970    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003973    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003975    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003978    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003981    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003983    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:49.005843 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003986    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003990    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003994    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.003997    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004000    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004002    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004005    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004008    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004010    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004013    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004016    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004019    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004022    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004025    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004027    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004030    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004033    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004035    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004038    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004040    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:49.006358 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004043    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004045    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004048    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004050    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004053    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004056    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004058    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004061    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004063    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004066    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004068    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004071    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004073    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004076    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004079    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004081    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004084    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004086    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004089    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004091    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:49.006848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004095    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004098    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004100    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004103    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004105    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004108    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004110    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004113    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004119    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004122    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004125    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004127    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004131    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004134    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004137    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.004140    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005002    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005018    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005024    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005029    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 17:17:49.007365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005033    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005037    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005041    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005046    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005049    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005053    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005057    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005060    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005063    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005066    2558 flags.go:64] FLAG: --cgroup-root=""
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005069    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005072    2558 flags.go:64] FLAG: --client-ca-file=""
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005075    2558 flags.go:64] FLAG: --cloud-config=""
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005078    2558 flags.go:64] FLAG: --cloud-provider="external"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005081    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005087    2558 flags.go:64] FLAG: --cluster-domain=""
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005090    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005093    2558 flags.go:64] FLAG: --config-dir=""
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005096    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005099    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005103    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005112    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005116    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005119    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 17:17:49.007844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005122    2558 flags.go:64] FLAG: --contention-profiling="false"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005125    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005128    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005134    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005137    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005142    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005145    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005148    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005150    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005154    2558 flags.go:64] FLAG: --enable-server="true"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005157    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005161    2558 flags.go:64] FLAG: --event-burst="100"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005164    2558 flags.go:64] FLAG: --event-qps="50"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005167    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005171    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005174    2558 flags.go:64] FLAG: --eviction-hard=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005177    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005180    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005183    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005186    2558 flags.go:64] FLAG: --eviction-soft=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005189    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005192    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005195    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005198    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005201    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 17:17:49.009248 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005204    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005208    2558 flags.go:64] FLAG: --feature-gates=""
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005211    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005214    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005218    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005222    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005225    2558 flags.go:64] FLAG: --healthz-port="10248"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005228    2558 flags.go:64] FLAG: --help="false"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005231    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005234    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005238    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005241    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005244    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005247    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005250    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005253    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005256    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005259    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005262    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005265    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005267    2558 flags.go:64] FLAG: --kube-reserved=""
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005270    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005273    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 17:17:49.009856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005277    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005280    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005282    2558 flags.go:64] FLAG: --lock-file=""
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005285    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005288    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005291    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005296    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005299    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005302    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005304    2558 flags.go:64] FLAG: --logging-format="text"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005307    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005311    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005313    2558 flags.go:64] FLAG: --manifest-url=""
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005316    2558 flags.go:64] FLAG: --manifest-url-header=""
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005321    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005324    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005329    2558 flags.go:64] FLAG: --max-pods="110"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005332    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005335    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005339    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005343    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005346    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005348    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005351    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005360    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 28 17:17:49.010415 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005363    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005366    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005369    2558 flags.go:64] FLAG: --pod-cidr=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005372    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005378    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005381    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005385    2558 flags.go:64] FLAG: --pods-per-core="0"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005388    2558 flags.go:64] FLAG: --port="10250"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005391    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005394    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d06199ac70d9519"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005397    2558 flags.go:64] FLAG: --qos-reserved=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005400    2558 flags.go:64] FLAG: --read-only-port="10255"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005403    2558 flags.go:64] FLAG: --register-node="true"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005405    2558 flags.go:64] FLAG: --register-schedulable="true"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005408    2558 flags.go:64] FLAG: --register-with-taints=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005416    2558 flags.go:64] FLAG: --registry-burst="10"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005419    2558 flags.go:64] FLAG: --registry-qps="5"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005422    2558 flags.go:64] FLAG: --reserved-cpus=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005424    2558 flags.go:64] FLAG: --reserved-memory=""
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005428    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005431    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005434    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005437    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005440    2558 flags.go:64] FLAG: --runonce="false"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005443    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 17:17:49.011047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005446    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005450    2558 flags.go:64] FLAG: --seccomp-default="false"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005453    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005456    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005459    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005462    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005465    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005468    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005471    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005475    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005478    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005481    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005484    2558 flags.go:64] FLAG: --system-cgroups=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005487    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005493    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005496    2558 flags.go:64] FLAG: --tls-cert-file=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005498    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005503    2558 flags.go:64] FLAG: --tls-min-version=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005506    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005508    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005511    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005514    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005517    2558 flags.go:64] FLAG: --v="2"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005521    2558 flags.go:64] FLAG: --version="false"
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005525    2558 flags.go:64] FLAG: --vmodule=""
May 28 17:17:49.011636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005529    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.005533    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005647    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005651    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005654    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005656    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005660    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005663    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005668    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005671    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005673    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005676    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005679    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005682    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005685    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005687    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005690    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005692    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005695    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005697    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:49.012322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005702    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005704    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005707    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005709    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005712    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005714    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005717    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005720    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005722    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005725    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005727    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005730    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005732    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005735    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005737    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005740    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005743    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005746    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005748    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005751    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:49.012840 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005756    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005759    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005761    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005765    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005769    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005772    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005774    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005777    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005779    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005782    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005784    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005787    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005791    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005793    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005796    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005798    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005801    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005803    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005806    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:49.013375 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005809    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005811    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005814    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005816    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005819    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005822    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005824    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005827    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005829    2558 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005832    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005834    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005837    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005839    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005844    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005847    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005850    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005852    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005855    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005858    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:49.013835 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005860    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005864    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005868    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005871    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005874    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005877    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005881    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005884    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005887    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.005889    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.006769    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.013565    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.013582    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013650    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013656    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:49.014323 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013659    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013663    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013666    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013668    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013672    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013674    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013677    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013680    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013682    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013685    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013687    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013691    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013693    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013696    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013700    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013702    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013705    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013708    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013710    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:49.014706 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013713    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013715    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013718    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013720    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013723    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013726    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013729    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013731    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013734    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013737    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013741    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013746    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013749    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013752    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013755    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013758    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013761    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013763    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013766    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:49.015200 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013768    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013771    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013774    2558 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013776    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013779    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013781    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013785    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013787    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013791    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013794    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013797    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013799    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013802    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013804    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013807    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013809    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013812    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013814    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013817    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013819    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:49.015659 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013823    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013825    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013828    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013831    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013833    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013836    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013839    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013842    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013844    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013847    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013850    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013853    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013855    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013858    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013860    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013863    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013867    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013870    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013873    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013876    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:49.016159 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013879    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013883    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013886    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013888    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013891    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.013894    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.013899    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014016    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014021    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014024    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014028    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014031    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014034    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014037    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014040    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:17:49.016698 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014043    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014047    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014050    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014053    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014056    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014058    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014061    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014064    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014067    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014069    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014072    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014074    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014077    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014079    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014082    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014084    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014087    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014090    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014093    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014095    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:17:49.017099 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014098    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014100    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014103    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014105    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014107    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014110    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014112    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014115    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014117    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014120    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014122    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014125    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014128    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014130    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014133    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014136    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014138    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014140    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014143    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014145    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:17:49.017581 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014148    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014150    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014154    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014157    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014160    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014163    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014165    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014168    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014170    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014173    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014177    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014179    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014182    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014184    2558 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014187    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014189    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014192    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014194    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014196    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:17:49.018115 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014199    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014201    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014204    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014208    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014211    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014215    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014218    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014220    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014223    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014227    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014229    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014232    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014235    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014238    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014240    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014243    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014246    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014248    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:17:49.018567 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:49.014251    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.014257    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.015096    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.017521    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.018633    2558 server.go:1019] "Starting client certificate rotation"
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.018734    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:17:49.019071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.018779    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:17:49.047847 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.047828    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:17:49.049780 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.049758    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:17:49.069031 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.069004    2558 log.go:25] "Validated CRI v1 runtime API"
May 28 17:17:49.075967 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.075951    2558 log.go:25] "Validated CRI v1 image API"
May 28 17:17:49.077464 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.077444    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 17:17:49.078676 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.078659    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:17:49.082108 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.082083    2558 fs.go:135] Filesystem UUIDs: map[39e07088-5f7c-42fc-afba-8e49abe5bce7:/dev/nvme0n1p4 55cd46ef-3b9d-4c78-b37e-e4167c3e4fce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 28 17:17:49.082164 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.082107    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 17:17:49.086419 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.086301    2558 manager.go:217] Machine: {Timestamp:2026-05-28 17:17:49.085804925 +0000 UTC m=+0.466929899 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101561 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24d6f66e06751a8c0fa5acc7e6fc9a SystemUUID:ec24d6f6-6e06-751a-8c0f-a5acc7e6fc9a BootID:8ce9c6c0-703f-434c-b54d-ba9225f5c71e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:b5:1c:84:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:b5:1c:84:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:b6:36:ef:e1:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 17:17:49.087237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.087225    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 17:17:49.087363 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.087350    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 17:17:49.089482 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089451    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 17:17:49.089635 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089484    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 17:17:49.089715 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089646    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 28 17:17:49.089715 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089654    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 28 17:17:49.089715 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089662    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:17:49.089715 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.089675    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:17:49.090982 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.090971    2558 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:17:49.091111 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.091101    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 17:17:49.093861 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.093850    2558 kubelet.go:491] "Attempting to sync node with API server"
May 28 17:17:49.093902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.093865    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 17:17:49.093902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.093876    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 17:17:49.093902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.093886    2558 kubelet.go:397] "Adding apiserver pod source"
May 28 17:17:49.093902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.093895    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 17:17:49.095574 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.095559    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:17:49.095574 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.095578    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:17:49.099343 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.099325    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 17:17:49.099622 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.099602    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vc6j6"
May 28 17:17:49.102309 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.102296    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 17:17:49.104405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104392    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104411    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104417    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104422    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104431    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104437    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104443    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104449    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 17:17:49.104455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104456    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 17:17:49.104682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104462    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 17:17:49.104682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104471    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 17:17:49.104682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.104478    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 17:17:49.105368 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.105347    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 17:17:49.105409 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.105349    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 17:17:49.105665 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.105651    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vc6j6"
May 28 17:17:49.106365 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.106354    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 17:17:49.106416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.106376    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 17:17:49.109804 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.109781    2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 17:17:49.110109 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.110094    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 17:17:49.110155 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.110136    2558 server.go:1295] "Started kubelet"
May 28 17:17:49.110264 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.110221    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 17:17:49.110314 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.110280    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 17:17:49.110360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.110237    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 17:17:49.111007 ip-10-0-128-101 systemd[1]: Started Kubernetes Kubelet.
May 28 17:17:49.111610 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.111596    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 17:17:49.113052 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.113039    2558 server.go:317] "Adding debug handlers to kubelet server"
May 28 17:17:49.119355 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.119335    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 17:17:49.120973 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.120949    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 17:17:49.121587 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121570    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 17:17:49.121674 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121646    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 17:17:49.121674 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121658    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 17:17:49.121834 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121797    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 17:17:49.121907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121867    2558 reconstruct.go:97] "Volume reconstruction finished"
May 28 17:17:49.121907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.121876    2558 reconciler.go:26] "Reconciler: start to sync state"
May 28 17:17:49.122628 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.122432    2558 factory.go:55] Registering systemd factory
May 28 17:17:49.122628 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.122629    2558 factory.go:223] Registration of the systemd container factory successfully
May 28 17:17:49.122933 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.122891    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.123020 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.122953    2558 factory.go:153] Registering CRI-O factory
May 28 17:17:49.123020 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.122970    2558 factory.go:223] Registration of the crio container factory successfully
May 28 17:17:49.123100 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.123061    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 17:17:49.123100 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.123081    2558 factory.go:103] Registering Raw factory
May 28 17:17:49.123100 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.123097    2558 manager.go:1196] Started watching for new ooms in manager
May 28 17:17:49.124223 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.124203    2558 manager.go:319] Starting recovery of all containers
May 28 17:17:49.125129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.125102    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:49.130604 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.130571    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-101.ec2.internal\" not found" node="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.134361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.134343    2558 manager.go:324] Recovery completed
May 28 17:17:49.139398 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.139384    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.141251 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141234    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.141310 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141266    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.141310 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141278    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.141775 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141760    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 17:17:49.141821 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141774    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 17:17:49.141821 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.141794    2558 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:17:49.145205 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.145194    2558 policy_none.go:49] "None policy: Start"
May 28 17:17:49.145249 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.145211    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 17:17:49.145249 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.145220    2558 state_mem.go:35] "Initializing new in-memory state store"
May 28 17:17:49.182525 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.182507    2558 manager.go:341] "Starting Device Plugin manager"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.182546    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.182559    2558 server.go:85] "Starting device plugin registration server"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.182794    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.182807    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.182951    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.183042    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.183051    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.183550    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 17:17:49.206768 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.183593    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.227615 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.227585    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 17:17:49.228776 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.228761    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 17:17:49.228865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.228782    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 17:17:49.228865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.228803    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 17:17:49.228865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.228813    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 17:17:49.228865 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.228859    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 17:17:49.231360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.231343    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:49.283966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.283896    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.284789 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.284775    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.284853 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.284803    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.284853 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.284813    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.284853 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.284837    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.292008 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.291995    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.292050 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.292015    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-101.ec2.internal\": node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.308668 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.308643    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.329307 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.329275    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"]
May 28 17:17:49.329364 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.329347    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.330951 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.330935    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.331049 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.330960    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.331049 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.330970    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.332122 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332110    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.332297 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332282    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.332336 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332318    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.332779 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332762    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.332779 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332773    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.332886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332795    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.332886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332795    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.332886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332811    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.332886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.332820    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.333995 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.333979    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.334042 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.334013    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:17:49.334617 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.334603    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:17:49.334686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.334628    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:17:49.334686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.334642    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeHasSufficientPID"
May 28 17:17:49.365606 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.365581    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-101.ec2.internal\" not found" node="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.370018 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.370001    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-101.ec2.internal\" not found" node="ip-10-0-128-101.ec2.internal"
May 28 17:17:49.409048 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.409026    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.423569 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.423550    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.423661 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.423575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.423661 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.423593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e8b1d9115a5af2eceab20799575e1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-101.ec2.internal\" (UID: \"dc5e8b1d9115a5af2eceab20799575e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.510002 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.509959    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.524351 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524321    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.524483 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524363    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.524483 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524387    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e8b1d9115a5af2eceab20799575e1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-101.ec2.internal\" (UID: \"dc5e8b1d9115a5af2eceab20799575e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.524483 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524390    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.524483 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524442    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc5e8b1d9115a5af2eceab20799575e1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-101.ec2.internal\" (UID: \"dc5e8b1d9115a5af2eceab20799575e1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.524483 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.524452    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/088faf21be35247d3c5f1ea20c7bd048-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal\" (UID: \"088faf21be35247d3c5f1ea20c7bd048\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.610772 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.610734    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.668196 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.668161    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.672856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:49.672828    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:49.711546 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.711512    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.812006 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.811978    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:49.912529 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:49.912458    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.013037 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:50.013004    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.018169 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.018152    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 17:17:50.018296 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.018274    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:17:50.018336 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.018311    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:17:50.109072 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.109032    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:12:49 +0000 UTC" deadline="2028-01-20 10:44:12.599717304 +0000 UTC"
May 28 17:17:50.109072 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.109069    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14441h26m22.490651949s"
May 28 17:17:50.114060 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:50.114033    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.121539 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.121510    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 17:17:50.131097 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.131077    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:17:50.150120 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.150097    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzrgn"
May 28 17:17:50.160220 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.160197    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzrgn"
May 28 17:17:50.214753 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:50.214730    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.225006 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:50.224964    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088faf21be35247d3c5f1ea20c7bd048.slice/crio-1d3108a3b4ad2c232aacc27113f1ebc3f29689a275d195f5c1ce73a137ab8a38 WatchSource:0}: Error finding container 1d3108a3b4ad2c232aacc27113f1ebc3f29689a275d195f5c1ce73a137ab8a38: Status 404 returned error can't find the container with id 1d3108a3b4ad2c232aacc27113f1ebc3f29689a275d195f5c1ce73a137ab8a38
May 28 17:17:50.225218 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:50.225202    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5e8b1d9115a5af2eceab20799575e1.slice/crio-efb512bedaf88ceaf468e7b6c0a6d95d5365647ee80a92265a8ae5195f049ce6 WatchSource:0}: Error finding container efb512bedaf88ceaf468e7b6c0a6d95d5365647ee80a92265a8ae5195f049ce6: Status 404 returned error can't find the container with id efb512bedaf88ceaf468e7b6c0a6d95d5365647ee80a92265a8ae5195f049ce6
May 28 17:17:50.229278 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.229265    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:17:50.231612 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.231578    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal" event={"ID":"088faf21be35247d3c5f1ea20c7bd048","Type":"ContainerStarted","Data":"1d3108a3b4ad2c232aacc27113f1ebc3f29689a275d195f5c1ce73a137ab8a38"}
May 28 17:17:50.232613 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.232590    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal" event={"ID":"dc5e8b1d9115a5af2eceab20799575e1","Type":"ContainerStarted","Data":"efb512bedaf88ceaf468e7b6c0a6d95d5365647ee80a92265a8ae5195f049ce6"}
May 28 17:17:50.315883 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:50.315848    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.416370 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:50.416330    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-101.ec2.internal\" not found"
May 28 17:17:50.514138 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.514066    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:50.522853 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.522823    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"
May 28 17:17:50.535567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.535539    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:17:50.537557 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.537541    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal"
May 28 17:17:50.579496 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.579471    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:50.633671 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:50.633632    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:17:51.095720 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.095687    2558 apiserver.go:52] "Watching apiserver"
May 28 17:17:51.107977 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.107951    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:51.108879 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.108855    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 17:17:51.110215 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.110180    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2xnv4","openshift-multus/network-metrics-daemon-jntd7","openshift-network-diagnostics/network-check-target-xgsr5","openshift-ovn-kubernetes/ovnkube-node-s5mhs","kube-system/konnectivity-agent-5zd64","kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cn4tz","openshift-dns/node-resolver-skstw","openshift-image-registry/node-ca-22rln","openshift-multus/multus-4f7s6","openshift-network-operator/iptables-alerter-fk7zn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal"]
May 28 17:17:51.112780 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.112756    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.114759 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.114736    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.114870 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.114815    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:17:51.115071 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.115047    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 17:17:51.115183 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.115164    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8knwf\""
May 28 17:17:51.115241 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.115224    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 17:17:51.116816 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.116792    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:51.116910 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.116863    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:17:51.119289 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.119138    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.122129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.121756    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 17:17:51.122129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.121778    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 17:17:51.122298 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.122286    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-59ppf\""
May 28 17:17:51.122448 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.122432    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 17:17:51.122617 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.122552    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 17:17:51.122698 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.122644    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 17:17:51.122698 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.122649    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 17:17:51.124140 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.123958    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.126129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.126106    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v8gkt\""
May 28 17:17:51.126129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.126126    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 17:17:51.126348 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.126334    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.126385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.126351    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 17:17:51.128810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.128695    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.129296 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129107    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 17:17:51.129296 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129291    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 17:17:51.129440 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129345    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 17:17:51.129512 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129448    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hp2wb\""
May 28 17:17:51.129562 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129529    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 17:17:51.129673 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.129658    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 17:17:51.130638 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.130620    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131437    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-host\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-tuned\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-node-log\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysconfig\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.131656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-tmp\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-systemd-units\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-log-socket\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-netd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac2a693-8316-404c-8444-027f38e16005-konnectivity-ca\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-conf\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-systemd\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-lib-modules\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-slash\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-systemd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.131995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-modprobe-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-script-lib\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-kubelet\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-netns\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-etc-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-ovn\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4rsd\" (UniqueName: \"kubernetes.io/projected/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-kube-api-access-x4rsd\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac2a693-8316-404c-8444-027f38e16005-agent-certs\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klps4\" (UniqueName: \"kubernetes.io/projected/40c24b68-d3f8-492f-a456-00027745fff5-kube-api-access-klps4\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132383    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-var-lib-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-bin\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-config\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-env-overrides\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132583    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovn-node-metrics-cert\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cnibin\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-system-cni-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.132811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-kubernetes\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-run\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132814    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-486d5\""
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-var-lib-kubelet\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q76g\" (UniqueName: \"kubernetes.io/projected/a3a24b22-9b3f-44e0-844c-48359370e0fc-kube-api-access-7q76g\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.132963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhwlz\" (UniqueName: \"kubernetes.io/projected/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-kube-api-access-fhwlz\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.133028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-os-release\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.133058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.133764 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.133079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-sys\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.134271 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.133967    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 17:17:51.134271 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.134133    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 17:17:51.134350 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.134333    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8zz5m\""
May 28 17:17:51.134482 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.134463    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.134603 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.134584    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.137176    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cz8hc\""
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.137493    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.137879    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wn2cg\""
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.138077    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.138458    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 17:17:51.138643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.138474    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 17:17:51.139257 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.139236    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.141353 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.141334    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 17:17:51.141542 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.141522    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 17:17:51.141622 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.141605    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27bsv\""
May 28 17:17:51.141718 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.141704    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 17:17:51.145268 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.145248    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:17:51.160911 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.160877    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:50 +0000 UTC" deadline="2027-12-09 10:04:32.478328209 +0000 UTC"
May 28 17:17:51.161008 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.160911    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13432h46m41.317421642s"
May 28 17:17:51.223079 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.223051    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 17:17:51.233271 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-netd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233277    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-systemd\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233299    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-lib-modules\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-bin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233337    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-netd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-kubelet\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233361    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-systemd\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233378    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-slash\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233402    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233423    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-modprobe-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-multus\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233463    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-lib-modules\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233423    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-slash\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233477    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-script-lib\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233533    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-etc-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233552    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-modprobe-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233560    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-ovn\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233585    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-daemon-config\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233618    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-ovn\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233603    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-etc-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.233739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-multus-certs\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.234175 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.233777    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.234175 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234021    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.234236 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234186    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-script-lib\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234236 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234213    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.234292 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1dcd7e8-a536-42de-bb77-f24342f87b68-host\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.234292 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234264    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-var-lib-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234292 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234285    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-bin\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234309    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-config\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234326    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-env-overrides\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234340    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovn-node-metrics-cert\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234342    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-cni-bin\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d19f277e-10b3-4194-a108-fe8c52722657-host-slash\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.234392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234335    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-var-lib-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234405    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-system-cni-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234429    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-run\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234453    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q76g\" (UniqueName: \"kubernetes.io/projected/a3a24b22-9b3f-44e0-844c-48359370e0fc-kube-api-access-7q76g\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234479    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/281ee264-b051-48b1-af78-81bc24fe2597-hosts-file\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-system-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234500    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-system-cni-dir\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234563    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-run\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-device-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.234649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234632    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234662    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhwlz\" (UniqueName: \"kubernetes.io/projected/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-kube-api-access-fhwlz\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234687    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-host\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234699    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234695    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234711    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-tuned\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234739    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-env-overrides\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-cni-binary-copy\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-socket-dir-parent\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234807    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovnkube-config\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-hostroot\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234871    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234872    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-host\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.234935    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234955    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-tmp\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.234986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/281ee264-b051-48b1-af78-81bc24fe2597-tmp-dir\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.235009    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:51.734981718 +0000 UTC m=+3.116106681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:51.235234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-etc-kubernetes\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4j9w\" (UniqueName: \"kubernetes.io/projected/663b0a07-77dc-47bb-b92c-53c73a823318-kube-api-access-n4j9w\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235103    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-systemd-units\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235126    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-log-socket\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-sys-fs\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235188    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac2a693-8316-404c-8444-027f38e16005-konnectivity-ca\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235197    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-systemd-units\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235208    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-conf\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235216    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-log-socket\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235263    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-openvswitch\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-netns\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mnc\" (UniqueName: \"kubernetes.io/projected/a48c9423-4135-4901-89bb-ee4f0b05f796-kube-api-access-w4mnc\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-socket-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235336    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-conf\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235368    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-systemd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.235975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235425    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235491    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdqt2\" (UniqueName: \"kubernetes.io/projected/281ee264-b051-48b1-af78-81bc24fe2597-kube-api-access-cdqt2\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235563    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-sys\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235605    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-sys\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1dcd7e8-a536-42de-bb77-f24342f87b68-serviceca\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2l5k\" (UniqueName: \"kubernetes.io/projected/d1dcd7e8-a536-42de-bb77-f24342f87b68-kube-api-access-x2l5k\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235679    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac2a693-8316-404c-8444-027f38e16005-konnectivity-ca\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235690    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-kubelet\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235728    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-netns\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235746    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-kubelet\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235771    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4rsd\" (UniqueName: \"kubernetes.io/projected/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-kube-api-access-x4rsd\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235791    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-run-netns\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79rl\" (UniqueName: \"kubernetes.io/projected/d19f277e-10b3-4194-a108-fe8c52722657-kube-api-access-h79rl\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235829    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-var-lib-kubelet\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-run-systemd\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235856    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac2a693-8316-404c-8444-027f38e16005-agent-certs\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.236777 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235886    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klps4\" (UniqueName: \"kubernetes.io/projected/40c24b68-d3f8-492f-a456-00027745fff5-kube-api-access-klps4\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235913    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cnibin\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-cnibin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235977    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cnibin\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.235901    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-var-lib-kubelet\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236107    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-kubernetes\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236139    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236179    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-kubernetes\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-conf-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d19f277e-10b3-4194-a108-fe8c52722657-iptables-alerter-script\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-registration-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236270    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysctl-d\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236289    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-os-release\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236319    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-os-release\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236368    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-os-release\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236370    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-node-log\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.237596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236410    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-node-log\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236419    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236445    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysconfig\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236454    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-k8s-cni-cncf-io\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236502    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-sysconfig\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.236793    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.238045    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-ovn-node-metrics-cert\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.238360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.238336    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-etc-tuned\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.238782 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.238766    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a24b22-9b3f-44e0-844c-48359370e0fc-tmp\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.239645 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.239627    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac2a693-8316-404c-8444-027f38e16005-agent-certs\") pod \"konnectivity-agent-5zd64\" (UID: \"fac2a693-8316-404c-8444-027f38e16005\") " pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.241438 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.241422    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:51.241438 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.241438    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:51.241538 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.241448    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:51.241538 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.241493    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:51.741479205 +0000 UTC m=+3.122604166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:51.246679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.244679    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhwlz\" (UniqueName: \"kubernetes.io/projected/7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a-kube-api-access-fhwlz\") pod \"ovnkube-node-s5mhs\" (UID: \"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.246679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.245035    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q76g\" (UniqueName: \"kubernetes.io/projected/a3a24b22-9b3f-44e0-844c-48359370e0fc-kube-api-access-7q76g\") pod \"tuned-cn4tz\" (UID: \"a3a24b22-9b3f-44e0-844c-48359370e0fc\") " pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.246679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.245356    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klps4\" (UniqueName: \"kubernetes.io/projected/40c24b68-d3f8-492f-a456-00027745fff5-kube-api-access-klps4\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.246679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.246194    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4rsd\" (UniqueName: \"kubernetes.io/projected/17762a6c-af3a-4d3b-9d25-b54aaee31d9d-kube-api-access-x4rsd\") pod \"multus-additional-cni-plugins-2xnv4\" (UID: \"17762a6c-af3a-4d3b-9d25-b54aaee31d9d\") " pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.337598 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337560    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d19f277e-10b3-4194-a108-fe8c52722657-host-slash\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.337598 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337600    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/281ee264-b051-48b1-af78-81bc24fe2597-hosts-file\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337624    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-system-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337646    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337667    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-device-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337689    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337689    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d19f277e-10b3-4194-a108-fe8c52722657-host-slash\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337718    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/281ee264-b051-48b1-af78-81bc24fe2597-hosts-file\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337723    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-system-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337723    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337726    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-cni-binary-copy\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.337830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337768    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-device-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337852    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-socket-dir-parent\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337883    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-hostroot\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337911    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-socket-dir-parent\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337937    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/281ee264-b051-48b1-af78-81bc24fe2597-tmp-dir\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337964    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-etc-kubernetes\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337970    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-hostroot\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337855    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.337989    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4j9w\" (UniqueName: \"kubernetes.io/projected/663b0a07-77dc-47bb-b92c-53c73a823318-kube-api-access-n4j9w\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338265    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/281ee264-b051-48b1-af78-81bc24fe2597-tmp-dir\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338294    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-etc-kubernetes\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338305    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-sys-fs\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338335    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338348    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-sys-fs\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338361    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-netns\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338378    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-cni-binary-copy\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338386    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mnc\" (UniqueName: \"kubernetes.io/projected/a48c9423-4135-4901-89bb-ee4f0b05f796-kube-api-access-w4mnc\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338408    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-socket-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338418    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-cni-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338435    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdqt2\" (UniqueName: \"kubernetes.io/projected/281ee264-b051-48b1-af78-81bc24fe2597-kube-api-access-cdqt2\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338443    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-netns\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338476    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1dcd7e8-a536-42de-bb77-f24342f87b68-serviceca\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338504    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2l5k\" (UniqueName: \"kubernetes.io/projected/d1dcd7e8-a536-42de-bb77-f24342f87b68-kube-api-access-x2l5k\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338535    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h79rl\" (UniqueName: \"kubernetes.io/projected/d19f277e-10b3-4194-a108-fe8c52722657-kube-api-access-h79rl\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-socket-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338567    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-cnibin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338595    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-conf-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d19f277e-10b3-4194-a108-fe8c52722657-iptables-alerter-script\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338657    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-registration-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.338810 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338683    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-os-release\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-conf-dir\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338732    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-cnibin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338734    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-k8s-cni-cncf-io\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338776    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-k8s-cni-cncf-io\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338779    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-bin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338800    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-bin\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338801    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/663b0a07-77dc-47bb-b92c-53c73a823318-registration-dir\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338822    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-kubelet\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338852    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-os-release\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338850    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-multus\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338892    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-daemon-config\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338895    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-cni-multus\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338916    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-multus-certs\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338936    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-var-lib-kubelet\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338938    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1dcd7e8-a536-42de-bb77-f24342f87b68-serviceca\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338957    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1dcd7e8-a536-42de-bb77-f24342f87b68-host\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.338976    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1dcd7e8-a536-42de-bb77-f24342f87b68-host\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.339554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.339024    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a48c9423-4135-4901-89bb-ee4f0b05f796-host-run-multus-certs\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.340110 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.339172    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d19f277e-10b3-4194-a108-fe8c52722657-iptables-alerter-script\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.340110 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.339377    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a48c9423-4135-4901-89bb-ee4f0b05f796-multus-daemon-config\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.346508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.346376    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79rl\" (UniqueName: \"kubernetes.io/projected/d19f277e-10b3-4194-a108-fe8c52722657-kube-api-access-h79rl\") pod \"iptables-alerter-fk7zn\" (UID: \"d19f277e-10b3-4194-a108-fe8c52722657\") " pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.346508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.346448    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4j9w\" (UniqueName: \"kubernetes.io/projected/663b0a07-77dc-47bb-b92c-53c73a823318-kube-api-access-n4j9w\") pod \"aws-ebs-csi-driver-node-gtwm6\" (UID: \"663b0a07-77dc-47bb-b92c-53c73a823318\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.346508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.346443    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mnc\" (UniqueName: \"kubernetes.io/projected/a48c9423-4135-4901-89bb-ee4f0b05f796-kube-api-access-w4mnc\") pod \"multus-4f7s6\" (UID: \"a48c9423-4135-4901-89bb-ee4f0b05f796\") " pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.346680 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.346574    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2l5k\" (UniqueName: \"kubernetes.io/projected/d1dcd7e8-a536-42de-bb77-f24342f87b68-kube-api-access-x2l5k\") pod \"node-ca-22rln\" (UID: \"d1dcd7e8-a536-42de-bb77-f24342f87b68\") " pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.346680 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.346631    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdqt2\" (UniqueName: \"kubernetes.io/projected/281ee264-b051-48b1-af78-81bc24fe2597-kube-api-access-cdqt2\") pod \"node-resolver-skstw\" (UID: \"281ee264-b051-48b1-af78-81bc24fe2597\") " pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.425671 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.425633    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cn4tz"
May 28 17:17:51.437442 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.437418    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:17:51.449255 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.449226    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:17:51.454839 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.454818    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xnv4"
May 28 17:17:51.461426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.461395    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22rln"
May 28 17:17:51.468958 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.468940    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-skstw"
May 28 17:17:51.477546 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.477524    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4f7s6"
May 28 17:17:51.486114 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.486094    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fk7zn"
May 28 17:17:51.491694 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.491674    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6"
May 28 17:17:51.741767 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.741688    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:51.741767 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:51.741730    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741837    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741870    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741885    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741896    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741935    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:52.741902365 +0000 UTC m=+4.123027346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:51.742003 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:51.741961    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:52.741944819 +0000 UTC m=+4.123069779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:52.021245 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.021070    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac2a693_8316_404c_8444_027f38e16005.slice/crio-f9c5a7e1c1d5bc1182275ba07c78907a253bdf4c1f76adabcc07e8d07ce76d75 WatchSource:0}: Error finding container f9c5a7e1c1d5bc1182275ba07c78907a253bdf4c1f76adabcc07e8d07ce76d75: Status 404 returned error can't find the container with id f9c5a7e1c1d5bc1182275ba07c78907a253bdf4c1f76adabcc07e8d07ce76d75
May 28 17:17:52.022313 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.022284    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663b0a07_77dc_47bb_b92c_53c73a823318.slice/crio-a14da97bb55a1fda566beddea09c85e8237649b9797a59c5800a176d631bcf92 WatchSource:0}: Error finding container a14da97bb55a1fda566beddea09c85e8237649b9797a59c5800a176d631bcf92: Status 404 returned error can't find the container with id a14da97bb55a1fda566beddea09c85e8237649b9797a59c5800a176d631bcf92
May 28 17:17:52.024192 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.023982    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48c9423_4135_4901_89bb_ee4f0b05f796.slice/crio-8fdb159781f4878959c72b17a2ce30858b1ecc290356d7d13f8080e89e3685a9 WatchSource:0}: Error finding container 8fdb159781f4878959c72b17a2ce30858b1ecc290356d7d13f8080e89e3685a9: Status 404 returned error can't find the container with id 8fdb159781f4878959c72b17a2ce30858b1ecc290356d7d13f8080e89e3685a9
May 28 17:17:52.027215 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.027188    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281ee264_b051_48b1_af78_81bc24fe2597.slice/crio-4bc450983a2e4a8145029b11ad3299c0c38b5b84af5a8f1f805e2903a871c31e WatchSource:0}: Error finding container 4bc450983a2e4a8145029b11ad3299c0c38b5b84af5a8f1f805e2903a871c31e: Status 404 returned error can't find the container with id 4bc450983a2e4a8145029b11ad3299c0c38b5b84af5a8f1f805e2903a871c31e
May 28 17:17:52.027970 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.027871    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19f277e_10b3_4194_a108_fe8c52722657.slice/crio-7230c266e2b0803eb3eb9c8df2777081a194832b42b945065b0ac60faf8a02be WatchSource:0}: Error finding container 7230c266e2b0803eb3eb9c8df2777081a194832b42b945065b0ac60faf8a02be: Status 404 returned error can't find the container with id 7230c266e2b0803eb3eb9c8df2777081a194832b42b945065b0ac60faf8a02be
May 28 17:17:52.049860 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.049825    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f55e9f6_0e2f_4ae9_81a0_5b7a036d256a.slice/crio-6cba0fea4a81eed2fd81dad587f47b06b4ecfa987b07bfa3a504a00d51bdf011 WatchSource:0}: Error finding container 6cba0fea4a81eed2fd81dad587f47b06b4ecfa987b07bfa3a504a00d51bdf011: Status 404 returned error can't find the container with id 6cba0fea4a81eed2fd81dad587f47b06b4ecfa987b07bfa3a504a00d51bdf011
May 28 17:17:52.051202 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.051175    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a24b22_9b3f_44e0_844c_48359370e0fc.slice/crio-2879b1170c548b0c9316bfd15b4ea55e77cd74934a20af93d7edd8430f89126b WatchSource:0}: Error finding container 2879b1170c548b0c9316bfd15b4ea55e77cd74934a20af93d7edd8430f89126b: Status 404 returned error can't find the container with id 2879b1170c548b0c9316bfd15b4ea55e77cd74934a20af93d7edd8430f89126b
May 28 17:17:52.051979 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.051908    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17762a6c_af3a_4d3b_9d25_b54aaee31d9d.slice/crio-c83be438d184b64370bfe17c9f4c8b06a9e7a91fbdc322b359b7484875622417 WatchSource:0}: Error finding container c83be438d184b64370bfe17c9f4c8b06a9e7a91fbdc322b359b7484875622417: Status 404 returned error can't find the container with id c83be438d184b64370bfe17c9f4c8b06a9e7a91fbdc322b359b7484875622417
May 28 17:17:52.052809 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:17:52.052773    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1dcd7e8_a536_42de_bb77_f24342f87b68.slice/crio-148c12b0f217cd40377d933fa719aa7463eaceda4a63c34eab0b0e7180701290 WatchSource:0}: Error finding container 148c12b0f217cd40377d933fa719aa7463eaceda4a63c34eab0b0e7180701290: Status 404 returned error can't find the container with id 148c12b0f217cd40377d933fa719aa7463eaceda4a63c34eab0b0e7180701290
May 28 17:17:52.162038 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.161995    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:12:50 +0000 UTC" deadline="2027-12-02 08:06:57.645280458 +0000 UTC"
May 28 17:17:52.162038 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.162036    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13262h49m5.483247854s"
May 28 17:17:52.229420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.229387    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:52.229593 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.229518    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:17:52.235419 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.235386    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fk7zn" event={"ID":"d19f277e-10b3-4194-a108-fe8c52722657","Type":"ContainerStarted","Data":"7230c266e2b0803eb3eb9c8df2777081a194832b42b945065b0ac60faf8a02be"}
May 28 17:17:52.239691 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.239666    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerStarted","Data":"c83be438d184b64370bfe17c9f4c8b06a9e7a91fbdc322b359b7484875622417"}
May 28 17:17:52.240684 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.240657    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"6cba0fea4a81eed2fd81dad587f47b06b4ecfa987b07bfa3a504a00d51bdf011"}
May 28 17:17:52.242322 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.242285    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal" event={"ID":"dc5e8b1d9115a5af2eceab20799575e1","Type":"ContainerStarted","Data":"2b592850731171ec2c5056e0a39810ffd29f0805527dceea5676b3a26612f87f"}
May 28 17:17:52.243461 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.243440    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22rln" event={"ID":"d1dcd7e8-a536-42de-bb77-f24342f87b68","Type":"ContainerStarted","Data":"148c12b0f217cd40377d933fa719aa7463eaceda4a63c34eab0b0e7180701290"}
May 28 17:17:52.244521 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.244497    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cn4tz" event={"ID":"a3a24b22-9b3f-44e0-844c-48359370e0fc","Type":"ContainerStarted","Data":"2879b1170c548b0c9316bfd15b4ea55e77cd74934a20af93d7edd8430f89126b"}
May 28 17:17:52.245663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.245642    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skstw" event={"ID":"281ee264-b051-48b1-af78-81bc24fe2597","Type":"ContainerStarted","Data":"4bc450983a2e4a8145029b11ad3299c0c38b5b84af5a8f1f805e2903a871c31e"}
May 28 17:17:52.246743 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.246724    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4f7s6" event={"ID":"a48c9423-4135-4901-89bb-ee4f0b05f796","Type":"ContainerStarted","Data":"8fdb159781f4878959c72b17a2ce30858b1ecc290356d7d13f8080e89e3685a9"}
May 28 17:17:52.247658 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.247638    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6" event={"ID":"663b0a07-77dc-47bb-b92c-53c73a823318","Type":"ContainerStarted","Data":"a14da97bb55a1fda566beddea09c85e8237649b9797a59c5800a176d631bcf92"}
May 28 17:17:52.248549 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.248531    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5zd64" event={"ID":"fac2a693-8316-404c-8444-027f38e16005","Type":"ContainerStarted","Data":"f9c5a7e1c1d5bc1182275ba07c78907a253bdf4c1f76adabcc07e8d07ce76d75"}
May 28 17:17:52.255045 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.255010    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-101.ec2.internal" podStartSLOduration=2.255000569 podStartE2EDuration="2.255000569s" podCreationTimestamp="2026-05-28 17:17:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:52.254818637 +0000 UTC m=+3.635943619" watchObservedRunningTime="2026-05-28 17:17:52.255000569 +0000 UTC m=+3.636125550"
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.748367    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:52.748474    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.748637    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.748657    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.748671    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.748732    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:54.748713308 +0000 UTC m=+6.129838292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:52.749181 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.749184    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:52.749652 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:52.749236    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:54.749221979 +0000 UTC m=+6.130346952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:53.231642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:53.231124    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:53.231642 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:53.231269    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:17:53.264198 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:53.263681    2558 generic.go:358] "Generic (PLEG): container finished" podID="088faf21be35247d3c5f1ea20c7bd048" containerID="19afee29b059e894d51c41caa2bc3c0299982193b4ec1b55d0004293c7f46195" exitCode=0
May 28 17:17:53.264198 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:53.264154    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal" event={"ID":"088faf21be35247d3c5f1ea20c7bd048","Type":"ContainerDied","Data":"19afee29b059e894d51c41caa2bc3c0299982193b4ec1b55d0004293c7f46195"}
May 28 17:17:54.229092 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:54.229043    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:54.229306 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.229184    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:17:54.283825 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:54.283787    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal" event={"ID":"088faf21be35247d3c5f1ea20c7bd048","Type":"ContainerStarted","Data":"1e674ce5a5ad4a02220ab91ea5103c4aa5b606956a9a0cba081bb2d9e0107bb1"}
May 28 17:17:54.299962 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:54.299416    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-101.ec2.internal" podStartSLOduration=4.299395877 podStartE2EDuration="4.299395877s" podCreationTimestamp="2026-05-28 17:17:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:17:54.299112336 +0000 UTC m=+5.680237319" watchObservedRunningTime="2026-05-28 17:17:54.299395877 +0000 UTC m=+5.680520864"
May 28 17:17:54.764124 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:54.764080    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:54.764320 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:54.764145    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:54.764320 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764293    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:54.764320 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764316    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:54.764465 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764330    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:54.764465 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764388    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:58.764370795 +0000 UTC m=+10.145495766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:54.764819 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764788    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:54.764910 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:54.764838    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:58.764823072 +0000 UTC m=+10.145948039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:55.232201 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:55.232165    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:55.232388 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:55.232339    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:17:56.230390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:56.229818    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:56.230390 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:56.229966    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:17:57.229613 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:57.229575    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:57.229783 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:57.229737    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:17:58.229182 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:58.229140    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:58.229641 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.229282    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:17:58.797960 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:58.797907    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:58.798142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:58.797985    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:17:58.798142 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798062    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:58.798142 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798120    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:58.798142 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798135    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:06.798114129 +0000 UTC m=+18.179239105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:58.798142 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798138    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:58.798413 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798153    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:58.798413 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:58.798202    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:06.798187209 +0000 UTC m=+18.179312171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:59.229967 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:17:59.229932    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:17:59.230435 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:17:59.230062    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:00.229245 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:00.229212    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:00.229431 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:00.229336    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:01.230126 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:01.230073    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:01.230581 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:01.230224    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:02.229508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:02.229427    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:02.229672 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:02.229525    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:03.229163 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:03.229123    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:03.229687 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:03.229275    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:04.229342 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:04.229303    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:04.229760 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:04.229446    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:05.229767 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:05.229730    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:05.230264 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:05.229853    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:06.229682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:06.229640    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:06.229858 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.229768    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:06.855148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:06.855110    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:06.855158    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855250    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855259    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855275    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855286    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:18:06.855332 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855326    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:22.855307663 +0000 UTC m=+34.236432635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:18:06.855556 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:06.855348    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:22.855337174 +0000 UTC m=+34.236462135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:18:07.229584 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:07.229509    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:07.229729 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:07.229640    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:08.229468 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:08.229434    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:08.229884 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:08.229563    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:09.230231 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:09.230187    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:09.230630 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:09.230318    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:10.229621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.229471    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:10.229721 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:10.229700    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:10.311702 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.311674    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22rln" event={"ID":"d1dcd7e8-a536-42de-bb77-f24342f87b68","Type":"ContainerStarted","Data":"84ab43892e2861c4252c5b327f5f89295839f6628bb96c2bb4c7b2a5d9230773"}
May 28 17:18:10.312968 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.312942    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cn4tz" event={"ID":"a3a24b22-9b3f-44e0-844c-48359370e0fc","Type":"ContainerStarted","Data":"47f9230a6cb6995ec7740969c9cef6fbdbb1480d2b19b23bff9d3c1df22839c7"}
May 28 17:18:10.314054 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.314030    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-skstw" event={"ID":"281ee264-b051-48b1-af78-81bc24fe2597","Type":"ContainerStarted","Data":"7820ae6e2e147a8cfe1187e945deec255e95446f343af4da42e1223d8d9e824f"}
May 28 17:18:10.315309 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.315280    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4f7s6" event={"ID":"a48c9423-4135-4901-89bb-ee4f0b05f796","Type":"ContainerStarted","Data":"8f6927b284b8c412f58bbb322da85a851a04fb5e309844f62c33ace53d139a99"}
May 28 17:18:10.316428 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.316411    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6" event={"ID":"663b0a07-77dc-47bb-b92c-53c73a823318","Type":"ContainerStarted","Data":"bb0bece24107c4f80a8f9a1fe74b885468ddb186fabc53582116e0eb8e4cad94"}
May 28 17:18:10.317680 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.317657    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5zd64" event={"ID":"fac2a693-8316-404c-8444-027f38e16005","Type":"ContainerStarted","Data":"9faae4bb16a30e361d793af1b1eae993248eabeeb905c9f8479a6aeaf40b6ccd"}
May 28 17:18:10.319014 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.318992    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="e30d86302460a96600fd7aff21bb36950d4963e08ec2b8d5caccf08161029b2e" exitCode=0
May 28 17:18:10.319091 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.319055    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"e30d86302460a96600fd7aff21bb36950d4963e08ec2b8d5caccf08161029b2e"}
May 28 17:18:10.320444 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.320430    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:18:10.320703 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.320684    2558 generic.go:358] "Generic (PLEG): container finished" podID="7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a" containerID="9d8613008e19b3d13b4722d0faf7f99d653e63cd04bd75767eb148368f5ab491" exitCode=1
May 28 17:18:10.320758 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.320720    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerDied","Data":"9d8613008e19b3d13b4722d0faf7f99d653e63cd04bd75767eb148368f5ab491"}
May 28 17:18:10.320758 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.320737    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"46ea66043c1be3489ff1e5bb2066597b2ee0b446d5a86de2ee0a7494b4931b99"}
May 28 17:18:10.325768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.325733    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-22rln" podStartSLOduration=3.67081898 podStartE2EDuration="21.325723592s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.056609974 +0000 UTC m=+3.437734933" lastFinishedPulling="2026-05-28 17:18:09.711514579 +0000 UTC m=+21.092639545" observedRunningTime="2026-05-28 17:18:10.325155283 +0000 UTC m=+21.706280266" watchObservedRunningTime="2026-05-28 17:18:10.325723592 +0000 UTC m=+21.706848575"
May 28 17:18:10.338022 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.337987    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5zd64" podStartSLOduration=7.350646383 podStartE2EDuration="21.337974889s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.023066565 +0000 UTC m=+3.404191524" lastFinishedPulling="2026-05-28 17:18:06.010395064 +0000 UTC m=+17.391520030" observedRunningTime="2026-05-28 17:18:10.33772523 +0000 UTC m=+21.718850211" watchObservedRunningTime="2026-05-28 17:18:10.337974889 +0000 UTC m=+21.719099871"
May 28 17:18:10.350279 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.350242    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-skstw" podStartSLOduration=3.685566992 podStartE2EDuration="21.350230677s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.046800756 +0000 UTC m=+3.427925719" lastFinishedPulling="2026-05-28 17:18:09.711464431 +0000 UTC m=+21.092589404" observedRunningTime="2026-05-28 17:18:10.349763244 +0000 UTC m=+21.730888227" watchObservedRunningTime="2026-05-28 17:18:10.350230677 +0000 UTC m=+21.731355659"
May 28 17:18:10.365486 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:10.365448    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cn4tz" podStartSLOduration=3.514147908 podStartE2EDuration="21.365436293s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.056394273 +0000 UTC m=+3.437519238" lastFinishedPulling="2026-05-28 17:18:09.907682657 +0000 UTC m=+21.288807623" observedRunningTime="2026-05-28 17:18:10.365121898 +0000 UTC m=+21.746246880" watchObservedRunningTime="2026-05-28 17:18:10.365436293 +0000 UTC m=+21.746561275"
May 28 17:18:11.052152 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.052009    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 17:18:11.195660 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.195524    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:18:11.052146879Z","UUID":"a4fc02ae-4315-4d4d-9225-cb248578b19f","Handler":null,"Name":"","Endpoint":""}
May 28 17:18:11.198886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.198857    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 17:18:11.198886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.198891    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 17:18:11.229477 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.229451    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:11.229586 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:11.229547    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:11.324366 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.324332    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6" event={"ID":"663b0a07-77dc-47bb-b92c-53c73a823318","Type":"ContainerStarted","Data":"5ea4289614a65b505dab9354f438e8e8214dc40c3a0e7c5e981f81ca070fc73c"}
May 28 17:18:11.325589 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.325564    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fk7zn" event={"ID":"d19f277e-10b3-4194-a108-fe8c52722657","Type":"ContainerStarted","Data":"471c54ed49e7f10d9e39675b014213c6f94672b0e85408a4d3cd5e49b4829e94"}
May 28 17:18:11.327994 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.327976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:18:11.328348 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.328321    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"a01f953a4901aa3affd1d046f7710fc9d9ae7dffa95d1774ab911a26e8d2d98a"}
May 28 17:18:11.328411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.328356    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"51f708e27e675726d34b0533677c85c81fdc56b19092d08363cc10a4b99fa42d"}
May 28 17:18:11.328411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.328372    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"0f2cb782d31799d08db682672ddb2addee320b4b916ed57e3307cb0c6b0f47b6"}
May 28 17:18:11.328411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.328386    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"8c2fcf5b4fdfa041281ffd26bdcbafa497420384df6c2538fc506ee66783d514"}
May 28 17:18:11.339055 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.339018    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4f7s6" podStartSLOduration=4.412418746 podStartE2EDuration="22.339002037s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.02604076 +0000 UTC m=+3.407165734" lastFinishedPulling="2026-05-28 17:18:09.952624037 +0000 UTC m=+21.333749025" observedRunningTime="2026-05-28 17:18:10.403069491 +0000 UTC m=+21.784194474" watchObservedRunningTime="2026-05-28 17:18:11.339002037 +0000 UTC m=+22.720127020"
May 28 17:18:11.339155 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:11.339120    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fk7zn" podStartSLOduration=4.674368414 podStartE2EDuration="22.339115389s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.046801498 +0000 UTC m=+3.427926458" lastFinishedPulling="2026-05-28 17:18:09.711548473 +0000 UTC m=+21.092673433" observedRunningTime="2026-05-28 17:18:11.338912304 +0000 UTC m=+22.720037293" watchObservedRunningTime="2026-05-28 17:18:11.339115389 +0000 UTC m=+22.720240370"
May 28 17:18:12.229289 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:12.229098    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:12.229399 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:12.229365    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:12.332695 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:12.332654    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6" event={"ID":"663b0a07-77dc-47bb-b92c-53c73a823318","Type":"ContainerStarted","Data":"682c27b11c95eb1f456a35fe4581e2092b530b3cf48265f695b71fa09926fdc2"}
May 28 17:18:12.350416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:12.350360    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtwm6" podStartSLOduration=3.264111836 podStartE2EDuration="23.35034548s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.024574332 +0000 UTC m=+3.405699292" lastFinishedPulling="2026-05-28 17:18:12.110807969 +0000 UTC m=+23.491932936" observedRunningTime="2026-05-28 17:18:12.349742209 +0000 UTC m=+23.730867193" watchObservedRunningTime="2026-05-28 17:18:12.35034548 +0000 UTC m=+23.731470461"
May 28 17:18:13.229646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:13.229617    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:13.229784 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:13.229716    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:13.339682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:13.339652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:18:13.340292 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:13.340095    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"97ab8456f73d4d0d238134483d8e2cc7e4e89523058285ceefbadf0e6427a75d"}
May 28 17:18:14.229906 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:14.229874    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:14.230083 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:14.229995    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:14.973002 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:14.972966    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:18:14.973701 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:14.973678    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:18:15.229789 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.229636    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:15.229948 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:15.229876    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:15.346719 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.346695    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:18:15.347060 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.347015    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"10470f5c8a5d9a8ea1c1a80ed59167162fea996f49471ef2b0fb9eaab9f5484f"}
May 28 17:18:15.347320 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.347297    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:18:15.347600 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.347585    2558 scope.go:117] "RemoveContainer" containerID="9d8613008e19b3d13b4722d0faf7f99d653e63cd04bd75767eb148368f5ab491"
May 28 17:18:15.347860 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:15.347841    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5zd64"
May 28 17:18:16.229897 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.229860    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:16.230431 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:16.230003    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:16.350423 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.350386    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="27a71e8a5da7db513aa940597e98ab286e3a8c5fb403350a6d5e71073c76308a" exitCode=0
May 28 17:18:16.350615 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.350468    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"27a71e8a5da7db513aa940597e98ab286e3a8c5fb403350a6d5e71073c76308a"}
May 28 17:18:16.353843 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.353825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:18:16.354277 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.354251    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" event={"ID":"7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a","Type":"ContainerStarted","Data":"a056fa870919c45a3ac4aef6a51e06a0b1837f3bbc4aef146564f3f8b1451d9a"}
May 28 17:18:16.357717 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.354629    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:16.357717 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.354665    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:16.357717 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.354682    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:16.370811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.370787    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:16.372586 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.372558    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:16.401316 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:16.401216    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs" podStartSLOduration=9.546994916 podStartE2EDuration="27.401201799s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.052175652 +0000 UTC m=+3.433300618" lastFinishedPulling="2026-05-28 17:18:09.906382537 +0000 UTC m=+21.287507501" observedRunningTime="2026-05-28 17:18:16.401139646 +0000 UTC m=+27.782264630" watchObservedRunningTime="2026-05-28 17:18:16.401201799 +0000 UTC m=+27.782326782"
May 28 17:18:17.229850 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:17.229810    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:17.230072 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:17.229976    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:18.229752 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:18.229725    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:18.229938 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:18.229813    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:18.360247 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:18.360213    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="a8e29ce3a7f146f472bfb13818daa1869ca2e31134854c4946b20f969f7f882b" exitCode=0
May 28 17:18:18.360723 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:18.360308    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"a8e29ce3a7f146f472bfb13818daa1869ca2e31134854c4946b20f969f7f882b"}
May 28 17:18:19.229939 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:19.229774    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:19.230119 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:19.230016    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:20.229047 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:20.229019    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:20.229458 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:20.229122    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:20.365859 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:20.365827    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="e687d2d98d95dcac3800ae9692a30b033f965e703c4e6625edccf3ffc32a8ae2" exitCode=0
May 28 17:18:20.366008 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:20.365873    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"e687d2d98d95dcac3800ae9692a30b033f965e703c4e6625edccf3ffc32a8ae2"}
May 28 17:18:21.229843 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:21.229808    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:21.230441 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:21.229959    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:22.229077 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:22.229040    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:22.229347 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.229178    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:22.876543 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:22.876511    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:22.876558    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876686    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876686    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876700    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876713    2558 projected.go:194] Error preparing data for projected volume kube-api-access-59ddk for pod openshift-network-diagnostics/network-check-target-xgsr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876748    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs podName:40c24b68-d3f8-492f-a456-00027745fff5 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:54.876730733 +0000 UTC m=+66.257855693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs") pod "network-metrics-daemon-jntd7" (UID: "40c24b68-d3f8-492f-a456-00027745fff5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:18:22.877190 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:22.876764    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk podName:64659e81-2211-4d05-8ed0-f60e4c601970 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:54.876756568 +0000 UTC m=+66.257881528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-59ddk" (UniqueName: "kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk") pod "network-check-target-xgsr5" (UID: "64659e81-2211-4d05-8ed0-f60e4c601970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:18:23.229572 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:23.229491    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:23.229736 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:23.229622    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:24.229679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:24.229645    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:24.230148 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:24.229756    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:25.230168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:25.230130    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:25.230562 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:25.230274    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:26.229771 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:26.229751    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:26.229864 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:26.229844    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:26.378065 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:26.378029    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="b4787852a39b9b2375c951ac513efe07f0a28927a6125c7dc9fd0946c450676e" exitCode=0
May 28 17:18:26.378559 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:26.378077    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"b4787852a39b9b2375c951ac513efe07f0a28927a6125c7dc9fd0946c450676e"}
May 28 17:18:27.229090 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:27.229054    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:27.229281 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:27.229166    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:27.382711 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:27.382680    2558 generic.go:358] "Generic (PLEG): container finished" podID="17762a6c-af3a-4d3b-9d25-b54aaee31d9d" containerID="5637cbf8454a8b6b0f2d38a75c7986f93dfd00cea9a4beeafbd7535abf28b56d" exitCode=0
May 28 17:18:27.383121 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:27.382736    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerDied","Data":"5637cbf8454a8b6b0f2d38a75c7986f93dfd00cea9a4beeafbd7535abf28b56d"}
May 28 17:18:28.230010 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:28.229960    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:28.230192 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:28.230075    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:28.387158 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:28.387120    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" event={"ID":"17762a6c-af3a-4d3b-9d25-b54aaee31d9d","Type":"ContainerStarted","Data":"b3d5a0608c47d62f80e256eafc40b2fe0481cbb3ecaa162245f63c5a48b3ca55"}
May 28 17:18:28.408726 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:28.408684    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2xnv4" podStartSLOduration=5.431889661 podStartE2EDuration="39.40866993s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:17:52.056426832 +0000 UTC m=+3.437551792" lastFinishedPulling="2026-05-28 17:18:26.033207087 +0000 UTC m=+37.414332061" observedRunningTime="2026-05-28 17:18:28.407083551 +0000 UTC m=+39.788208533" watchObservedRunningTime="2026-05-28 17:18:28.40866993 +0000 UTC m=+39.789794912"
May 28 17:18:29.230185 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:29.230152    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:29.230366 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:29.230280    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:30.229566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:30.229527    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:30.230066 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:30.229655    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:31.188565 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:31.188281    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xgsr5"]
May 28 17:18:31.188726 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:31.188649    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:31.188824 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:31.188797    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:31.190976 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:31.190951    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jntd7"]
May 28 17:18:31.191100 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:31.191082    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:31.191216 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:31.191193    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:33.229618 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:33.229587    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:33.230327 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:33.229695    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgsr5" podUID="64659e81-2211-4d05-8ed0-f60e4c601970"
May 28 17:18:33.230327 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:33.229770    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:33.230327 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:33.229855    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jntd7" podUID="40c24b68-d3f8-492f-a456-00027745fff5"
May 28 17:18:34.952389 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:34.952361    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-101.ec2.internal" event="NodeReady"
May 28 17:18:34.952788 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:34.952477    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 17:18:34.993212 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:34.993186    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lq6wn"]
May 28 17:18:34.999627 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:34.999606    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hkj8n"]
May 28 17:18:34.999781 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:34.999762    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.025941 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.018952    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 17:18:35.025941 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.019268    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 17:18:35.025941 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.019515    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 17:18:35.025941 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.021837    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 17:18:35.026312 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.026258    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qmhp7\""
May 28 17:18:35.039429 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.039399    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lq6wn"]
May 28 17:18:35.039584 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.039562    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.039861 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.039841    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkj8n"]
May 28 17:18:35.042078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.042054    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 17:18:35.042078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.042062    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4rht\""
May 28 17:18:35.042078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.042086    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 17:18:35.042278 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.042054    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 17:18:35.094909 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.094884    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cvcq9"]
May 28 17:18:35.103637 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.103615    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.104902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.104878    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvcq9"]
May 28 17:18:35.106116 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.106095    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bs9nj\""
May 28 17:18:35.106221 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.106095    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 17:18:35.106221 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.106150    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 17:18:35.165172 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f591e72e-bc68-4930-9405-481321417b2b-crio-socket\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.165172 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f591e72e-bc68-4930-9405-481321417b2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.165388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f591e72e-bc68-4930-9405-481321417b2b-data-volume\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.165388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffkl\" (UniqueName: \"kubernetes.io/projected/2016f273-c297-48df-8aa7-efaa72c67142-kube-api-access-hffkl\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.165388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f591e72e-bc68-4930-9405-481321417b2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.165388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntm47\" (UniqueName: \"kubernetes.io/projected/f591e72e-bc68-4930-9405-481321417b2b-kube-api-access-ntm47\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.165388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.165387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2016f273-c297-48df-8aa7-efaa72c67142-cert\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.229710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.229643    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:35.229878 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.229855    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:35.232848 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.232822    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:18:35.233326 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.233307    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:18:35.233421 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.233372    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9td\""
May 28 17:18:35.233421 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.233392    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:18:35.233528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.233372    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5snq\""
May 28 17:18:35.266235 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266207    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f591e72e-bc68-4930-9405-481321417b2b-data-volume\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e90f2b94-0e57-469f-89e3-005af223d2e2-config-volume\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.266369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266263    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hffkl\" (UniqueName: \"kubernetes.io/projected/2016f273-c297-48df-8aa7-efaa72c67142-kube-api-access-hffkl\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.266369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e90f2b94-0e57-469f-89e3-005af223d2e2-metrics-tls\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.266369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266320    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f591e72e-bc68-4930-9405-481321417b2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266356    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntm47\" (UniqueName: \"kubernetes.io/projected/f591e72e-bc68-4930-9405-481321417b2b-kube-api-access-ntm47\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e90f2b94-0e57-469f-89e3-005af223d2e2-tmp-dir\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7l45\" (UniqueName: \"kubernetes.io/projected/e90f2b94-0e57-469f-89e3-005af223d2e2-kube-api-access-p7l45\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266433    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2016f273-c297-48df-8aa7-efaa72c67142-cert\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266469    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f591e72e-bc68-4930-9405-481321417b2b-crio-socket\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266494    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f591e72e-bc68-4930-9405-481321417b2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266602 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266570    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f591e72e-bc68-4930-9405-481321417b2b-data-volume\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.266828 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.266700    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f591e72e-bc68-4930-9405-481321417b2b-crio-socket\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.267022 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.267001    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f591e72e-bc68-4930-9405-481321417b2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.270210 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.270188    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f591e72e-bc68-4930-9405-481321417b2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.270355 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.270338    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2016f273-c297-48df-8aa7-efaa72c67142-cert\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.274420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.274392    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntm47\" (UniqueName: \"kubernetes.io/projected/f591e72e-bc68-4930-9405-481321417b2b-kube-api-access-ntm47\") pod \"insights-runtime-extractor-lq6wn\" (UID: \"f591e72e-bc68-4930-9405-481321417b2b\") " pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.274545 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.274476    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffkl\" (UniqueName: \"kubernetes.io/projected/2016f273-c297-48df-8aa7-efaa72c67142-kube-api-access-hffkl\") pod \"ingress-canary-hkj8n\" (UID: \"2016f273-c297-48df-8aa7-efaa72c67142\") " pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.348372 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.348342    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lq6wn"
May 28 17:18:35.353710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.353678    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkj8n"
May 28 17:18:35.367543 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.367519    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e90f2b94-0e57-469f-89e3-005af223d2e2-config-volume\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.367667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.367556    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e90f2b94-0e57-469f-89e3-005af223d2e2-metrics-tls\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.367667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.367592    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e90f2b94-0e57-469f-89e3-005af223d2e2-tmp-dir\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.367667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.367613    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7l45\" (UniqueName: \"kubernetes.io/projected/e90f2b94-0e57-469f-89e3-005af223d2e2-kube-api-access-p7l45\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.368142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.368113    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e90f2b94-0e57-469f-89e3-005af223d2e2-tmp-dir\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.368242 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.368200    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e90f2b94-0e57-469f-89e3-005af223d2e2-config-volume\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.370315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.370294    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e90f2b94-0e57-469f-89e3-005af223d2e2-metrics-tls\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.375329 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.375306    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7l45\" (UniqueName: \"kubernetes.io/projected/e90f2b94-0e57-469f-89e3-005af223d2e2-kube-api-access-p7l45\") pod \"dns-default-cvcq9\" (UID: \"e90f2b94-0e57-469f-89e3-005af223d2e2\") " pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.412866 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.412838    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:35.550587 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.550557    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkj8n"]
May 28 17:18:35.554015 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:35.553979    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2016f273_c297_48df_8aa7_efaa72c67142.slice/crio-5260187a84eb3e15cc85f5d98639613faef00e3ee800e6c7e4b57aaf7d7e752c WatchSource:0}: Error finding container 5260187a84eb3e15cc85f5d98639613faef00e3ee800e6c7e4b57aaf7d7e752c: Status 404 returned error can't find the container with id 5260187a84eb3e15cc85f5d98639613faef00e3ee800e6c7e4b57aaf7d7e752c
May 28 17:18:35.565705 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.565681    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lq6wn"]
May 28 17:18:35.566151 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:35.566133    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvcq9"]
May 28 17:18:35.583426 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:35.583402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90f2b94_0e57_469f_89e3_005af223d2e2.slice/crio-d1539605f54e93305283953fe48dd86b941739676f5e8194654931a7c4286fa1 WatchSource:0}: Error finding container d1539605f54e93305283953fe48dd86b941739676f5e8194654931a7c4286fa1: Status 404 returned error can't find the container with id d1539605f54e93305283953fe48dd86b941739676f5e8194654931a7c4286fa1
May 28 17:18:35.584322 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:35.584303    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf591e72e_bc68_4930_9405_481321417b2b.slice/crio-3d948151646895fcb1e15ff0f2fb5d77b66f719a1f5d16b242dac3c29e6ec032 WatchSource:0}: Error finding container 3d948151646895fcb1e15ff0f2fb5d77b66f719a1f5d16b242dac3c29e6ec032: Status 404 returned error can't find the container with id 3d948151646895fcb1e15ff0f2fb5d77b66f719a1f5d16b242dac3c29e6ec032
May 28 17:18:36.405443 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:36.405212    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvcq9" event={"ID":"e90f2b94-0e57-469f-89e3-005af223d2e2","Type":"ContainerStarted","Data":"d1539605f54e93305283953fe48dd86b941739676f5e8194654931a7c4286fa1"}
May 28 17:18:36.406975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:36.406898    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkj8n" event={"ID":"2016f273-c297-48df-8aa7-efaa72c67142","Type":"ContainerStarted","Data":"5260187a84eb3e15cc85f5d98639613faef00e3ee800e6c7e4b57aaf7d7e752c"}
May 28 17:18:36.408763 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:36.408704    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq6wn" event={"ID":"f591e72e-bc68-4930-9405-481321417b2b","Type":"ContainerStarted","Data":"c5ad0e1a519655ef768763adf23e04daa09893e146368aa4fbaa083e4537e5ac"}
May 28 17:18:36.408763 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:36.408741    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq6wn" event={"ID":"f591e72e-bc68-4930-9405-481321417b2b","Type":"ContainerStarted","Data":"3d948151646895fcb1e15ff0f2fb5d77b66f719a1f5d16b242dac3c29e6ec032"}
May 28 17:18:38.414643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.414558    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvcq9" event={"ID":"e90f2b94-0e57-469f-89e3-005af223d2e2","Type":"ContainerStarted","Data":"d44c16998d7abd1c278da131e9b9f7aca3a9bb767b16488a1862644f84eeb0ee"}
May 28 17:18:38.414643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.414597    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvcq9" event={"ID":"e90f2b94-0e57-469f-89e3-005af223d2e2","Type":"ContainerStarted","Data":"761589f2ae38813e2ac4da3cd90f88a641ff98388c29c9a127b8422565704817"}
May 28 17:18:38.415431 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.414671    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:38.415904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.415869    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkj8n" event={"ID":"2016f273-c297-48df-8aa7-efaa72c67142","Type":"ContainerStarted","Data":"b1d65c4176418cf64d872e50c1843d359376db41f449012cd326cfa381f2aa24"}
May 28 17:18:38.417428 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.417405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq6wn" event={"ID":"f591e72e-bc68-4930-9405-481321417b2b","Type":"ContainerStarted","Data":"8e29fa0cc5b7805a9675c3e42a329f4121ad6976179692ccc4e10172728bf9c2"}
May 28 17:18:38.429876 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.429836    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cvcq9" podStartSLOduration=0.986892693 podStartE2EDuration="3.429824967s" podCreationTimestamp="2026-05-28 17:18:35 +0000 UTC" firstStartedPulling="2026-05-28 17:18:35.585292948 +0000 UTC m=+46.966417907" lastFinishedPulling="2026-05-28 17:18:38.028225217 +0000 UTC m=+49.409350181" observedRunningTime="2026-05-28 17:18:38.429272392 +0000 UTC m=+49.810397376" watchObservedRunningTime="2026-05-28 17:18:38.429824967 +0000 UTC m=+49.810949949"
May 28 17:18:38.444076 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:38.444038    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hkj8n" podStartSLOduration=1.967126778 podStartE2EDuration="4.444027201s" podCreationTimestamp="2026-05-28 17:18:34 +0000 UTC" firstStartedPulling="2026-05-28 17:18:35.555902756 +0000 UTC m=+46.937027720" lastFinishedPulling="2026-05-28 17:18:38.03280318 +0000 UTC m=+49.413928143" observedRunningTime="2026-05-28 17:18:38.443455746 +0000 UTC m=+49.824580727" watchObservedRunningTime="2026-05-28 17:18:38.444027201 +0000 UTC m=+49.825152215"
May 28 17:18:39.293323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.292329    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"]
May 28 17:18:39.330100 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.329882    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"]
May 28 17:18:39.330237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.330072    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.333063 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333034    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 17:18:39.333253 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333231    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 17:18:39.333362 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333335    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 17:18:39.333468 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333447    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zzh2f\""
May 28 17:18:39.333582 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333481    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 17:18:39.333582 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.333483    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 17:18:39.498531 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.498492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.498531 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.498531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56e17a39-0340-4341-a001-847577cb1676-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.498956 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.498561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.498956 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.498586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwnsk\" (UniqueName: \"kubernetes.io/projected/56e17a39-0340-4341-a001-847577cb1676-kube-api-access-cwnsk\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.599744 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.599705    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.599744 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.599750    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56e17a39-0340-4341-a001-847577cb1676-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.600053 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.599895    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.600053 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.600028    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwnsk\" (UniqueName: \"kubernetes.io/projected/56e17a39-0340-4341-a001-847577cb1676-kube-api-access-cwnsk\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.600582 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.600556    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56e17a39-0340-4341-a001-847577cb1676-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.603563 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.603543    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.603563 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.603555    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/56e17a39-0340-4341-a001-847577cb1676-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.610454 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.610426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwnsk\" (UniqueName: \"kubernetes.io/projected/56e17a39-0340-4341-a001-847577cb1676-kube-api-access-cwnsk\") pod \"prometheus-operator-7779bbdd78-zcwss\" (UID: \"56e17a39-0340-4341-a001-847577cb1676\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.642180 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.642151    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"
May 28 17:18:39.763326 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:39.763290    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zcwss"]
May 28 17:18:39.881757 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:39.881663    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e17a39_0340_4341_a001_847577cb1676.slice/crio-1d9f87d638b841502f1230f06d40b80a3189dfc68604b7e1698bcb5c67a301d9 WatchSource:0}: Error finding container 1d9f87d638b841502f1230f06d40b80a3189dfc68604b7e1698bcb5c67a301d9: Status 404 returned error can't find the container with id 1d9f87d638b841502f1230f06d40b80a3189dfc68604b7e1698bcb5c67a301d9
May 28 17:18:40.425267 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:40.425215    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq6wn" event={"ID":"f591e72e-bc68-4930-9405-481321417b2b","Type":"ContainerStarted","Data":"e68a5a4fc0b72575f094479b840bc9ab01d58b88bb4edefa848e9b86e1ac77a6"}
May 28 17:18:40.426456 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:40.426429    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss" event={"ID":"56e17a39-0340-4341-a001-847577cb1676","Type":"ContainerStarted","Data":"1d9f87d638b841502f1230f06d40b80a3189dfc68604b7e1698bcb5c67a301d9"}
May 28 17:18:40.444058 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:40.444014    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lq6wn" podStartSLOduration=2.209370705 podStartE2EDuration="6.443999828s" podCreationTimestamp="2026-05-28 17:18:34 +0000 UTC" firstStartedPulling="2026-05-28 17:18:35.680737742 +0000 UTC m=+47.061862702" lastFinishedPulling="2026-05-28 17:18:39.915366848 +0000 UTC m=+51.296491825" observedRunningTime="2026-05-28 17:18:40.443250455 +0000 UTC m=+51.824375437" watchObservedRunningTime="2026-05-28 17:18:40.443999828 +0000 UTC m=+51.825124809"
May 28 17:18:42.433383 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:42.433151    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss" event={"ID":"56e17a39-0340-4341-a001-847577cb1676","Type":"ContainerStarted","Data":"f4f2a6aadefbafabf7836a0e1eeb996528651c581bbf026d351c4cbeffedb58b"}
May 28 17:18:42.433865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:42.433396    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss" event={"ID":"56e17a39-0340-4341-a001-847577cb1676","Type":"ContainerStarted","Data":"28e707bfb3911963daae3bf5562372cf0b9572440eca52177268c3907a7128a0"}
May 28 17:18:42.450816 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:42.450760    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zcwss" podStartSLOduration=1.884537124 podStartE2EDuration="3.450742598s" podCreationTimestamp="2026-05-28 17:18:39 +0000 UTC" firstStartedPulling="2026-05-28 17:18:39.910329223 +0000 UTC m=+51.291454184" lastFinishedPulling="2026-05-28 17:18:41.476534698 +0000 UTC m=+52.857659658" observedRunningTime="2026-05-28 17:18:42.449979833 +0000 UTC m=+53.831104811" watchObservedRunningTime="2026-05-28 17:18:42.450742598 +0000 UTC m=+53.831867581"
May 28 17:18:44.639054 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.639019    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"]
May 28 17:18:44.663649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.663620    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"]
May 28 17:18:44.663649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.663653    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"]
May 28 17:18:44.663874 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.663802    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.666619 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.666592    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wmfzr\""
May 28 17:18:44.666760 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.666697    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 17:18:44.666760 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.666697    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 17:18:44.677433 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.677409    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qcmtr"]
May 28 17:18:44.677567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.677552    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.680320 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.680289    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rvn67\""
May 28 17:18:44.680442 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.680321    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 17:18:44.680442 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.680418    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 17:18:44.681010 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.680995    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 17:18:44.699509 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.699486    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"]
May 28 17:18:44.699633 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.699614    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.702468 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.702440    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ns2zv\""
May 28 17:18:44.702468 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.702452    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 17:18:44.702644 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.702468    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 17:18:44.702644 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.702497    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 17:18:44.738696 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c87324-d4a2-46b5-8407-e0331ec51f8d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.738696 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvsrv\" (UniqueName: \"kubernetes.io/projected/8207f4fe-4045-4363-9f77-abc94b48520f-kube-api-access-zvsrv\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-metrics-client-ca\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.738886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4vss\" (UniqueName: \"kubernetes.io/projected/b7c87324-d4a2-46b5-8407-e0331ec51f8d-kube-api-access-t4vss\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-sys\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.738964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxj9c\" (UniqueName: \"kubernetes.io/projected/c3981277-d06e-4f2d-b134-ed4a720fcd50-kube-api-access-qxj9c\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739173 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8207f4fe-4045-4363-9f77-abc94b48520f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.739417 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-root\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739417 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-textfile\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.739417 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.739417 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.739282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-wtmp\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.839705 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839669    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839709    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839747    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839764    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvsrv\" (UniqueName: \"kubernetes.io/projected/8207f4fe-4045-4363-9f77-abc94b48520f-kube-api-access-zvsrv\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839801    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839822    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-metrics-client-ca\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.839877 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839843    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4vss\" (UniqueName: \"kubernetes.io/projected/b7c87324-d4a2-46b5-8407-e0331ec51f8d-kube-api-access-t4vss\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:44.839880    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839954    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-sys\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.839886    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-sys\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:44.840007    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls podName:c3981277-d06e-4f2d-b134-ed4a720fcd50 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:45.339985858 +0000 UTC m=+56.721110830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls") pod "node-exporter-qcmtr" (UID: "c3981277-d06e-4f2d-b134-ed4a720fcd50") : secret "node-exporter-tls" not found
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840057    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840091    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840120    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxj9c\" (UniqueName: \"kubernetes.io/projected/c3981277-d06e-4f2d-b134-ed4a720fcd50-kube-api-access-qxj9c\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840184 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840151    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840190    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840219    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8207f4fe-4045-4363-9f77-abc94b48520f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840253    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-root\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840285    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-textfile\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840335    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840374    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-wtmp\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840566 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840558    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-metrics-client-ca\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840900 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840631    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c87324-d4a2-46b5-8407-e0331ec51f8d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.840900 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:44.840770    2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 17:18:44.840900 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:44.840811    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls podName:8207f4fe-4045-4363-9f77-abc94b48520f nodeName:}" failed. No retries permitted until 2026-05-28 17:18:45.340797514 +0000 UTC m=+56.721922474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-wj48c" (UID: "8207f4fe-4045-4363-9f77-abc94b48520f") : secret "kube-state-metrics-tls" not found
May 28 17:18:44.840900 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840817    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-textfile\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.840900 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840871    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-root\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.841183 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840945    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-wtmp\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.841183 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.840990    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8207f4fe-4045-4363-9f77-abc94b48520f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.841323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.841301    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.841461 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.841419    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.841649 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.841627    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c87324-d4a2-46b5-8407-e0331ec51f8d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.841909 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.841891    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.843940 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.843897    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.844023 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.843941    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.844023 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.843955    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c87324-d4a2-46b5-8407-e0331ec51f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.844023 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.843937    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.849217 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.849175    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvsrv\" (UniqueName: \"kubernetes.io/projected/8207f4fe-4045-4363-9f77-abc94b48520f-kube-api-access-zvsrv\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:44.849446 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.849424    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4vss\" (UniqueName: \"kubernetes.io/projected/b7c87324-d4a2-46b5-8407-e0331ec51f8d-kube-api-access-t4vss\") pod \"openshift-state-metrics-9c959559f-hxxkx\" (UID: \"b7c87324-d4a2-46b5-8407-e0331ec51f8d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:44.849587 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.849572    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxj9c\" (UniqueName: \"kubernetes.io/projected/c3981277-d06e-4f2d-b134-ed4a720fcd50-kube-api-access-qxj9c\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:44.974509 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:44.974429    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"
May 28 17:18:45.100087 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.100058    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx"]
May 28 17:18:45.103231 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:45.103197    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c87324_d4a2_46b5_8407_e0331ec51f8d.slice/crio-430cc0f88492a850a1b0c96cde1a017dfc9265f6d3ad14b280be5988a660c062 WatchSource:0}: Error finding container 430cc0f88492a850a1b0c96cde1a017dfc9265f6d3ad14b280be5988a660c062: Status 404 returned error can't find the container with id 430cc0f88492a850a1b0c96cde1a017dfc9265f6d3ad14b280be5988a660c062
May 28 17:18:45.345288 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.345257    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:45.345405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.345318    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:45.345467 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:45.345426    2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 17:18:45.345516 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:18:45.345506    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls podName:8207f4fe-4045-4363-9f77-abc94b48520f nodeName:}" failed. No retries permitted until 2026-05-28 17:18:46.345485191 +0000 UTC m=+57.726610174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-wj48c" (UID: "8207f4fe-4045-4363-9f77-abc94b48520f") : secret "kube-state-metrics-tls" not found
May 28 17:18:45.347467 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.347446    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3981277-d06e-4f2d-b134-ed4a720fcd50-node-exporter-tls\") pod \"node-exporter-qcmtr\" (UID: \"c3981277-d06e-4f2d-b134-ed4a720fcd50\") " pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:45.444062 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.444025    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx" event={"ID":"b7c87324-d4a2-46b5-8407-e0331ec51f8d","Type":"ContainerStarted","Data":"546817bc3c41fcc461f8ecfb711934274b2680672706e80ad5c9f3a61c76ca97"}
May 28 17:18:45.444062 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.444063    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx" event={"ID":"b7c87324-d4a2-46b5-8407-e0331ec51f8d","Type":"ContainerStarted","Data":"4e500e0c0988aa6446867e74589ab1ca27c9567b3ebac7f39b8fc7aa5e4e4450"}
May 28 17:18:45.444249 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.444072    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx" event={"ID":"b7c87324-d4a2-46b5-8407-e0331ec51f8d","Type":"ContainerStarted","Data":"430cc0f88492a850a1b0c96cde1a017dfc9265f6d3ad14b280be5988a660c062"}
May 28 17:18:45.607706 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.607677    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qcmtr"
May 28 17:18:45.616173 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:45.616145    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3981277_d06e_4f2d_b134_ed4a720fcd50.slice/crio-628a9479e843e31c71b55a0e62659d56b83dcf6f28b2422367785f3ee2c16644 WatchSource:0}: Error finding container 628a9479e843e31c71b55a0e62659d56b83dcf6f28b2422367785f3ee2c16644: Status 404 returned error can't find the container with id 628a9479e843e31c71b55a0e62659d56b83dcf6f28b2422367785f3ee2c16644
May 28 17:18:45.725637 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.725602    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:18:45.757500 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.757467    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:18:45.757656 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.757613    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.760350 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760322    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:18:45.760686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760641    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:18:45.760686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760647    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:18:45.760686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760681    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:18:45.761044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760952    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:18:45.761044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760952    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:18:45.761044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.760992    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:18:45.761225 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.761059    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-b957n\""
May 28 17:18:45.761225 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.761068    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:18:45.761225 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.761072    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:18:45.849701 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcfkw\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.849701 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.849910 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.849910 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.849910 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.849910 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850088 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.849956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850088 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850088 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850088 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850283 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850283 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.850283 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.850141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.950944 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.950833    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.950944 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.950910    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951169 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.950954    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951311 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951284    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951389 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951336    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951389 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951370    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951489 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951406    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951489 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951434    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951593 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951493    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcfkw\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951593 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951513    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951593 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951540    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951740 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951591    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.951740 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.951623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.952369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.952339    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.952857 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.952823    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.953070 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.953045    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.954048 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.954002    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.954569 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.954527    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.954856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.954782    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.954982 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.954866    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.955745 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.955715    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.956362 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.956320    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.956362 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.956336    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.956563 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.956544    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.957060 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.957042    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:45.960865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:45.960842    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcfkw\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw\") pod \"alertmanager-main-0\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:46.069429 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.069219    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:18:46.222025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.221939    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:18:46.355400 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.355366    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:46.358231 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.358171    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8207f4fe-4045-4363-9f77-abc94b48520f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wj48c\" (UID: \"8207f4fe-4045-4363-9f77-abc94b48520f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:46.422802 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:46.422770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0500f3_f748_4f8e_9264_77814cb6e909.slice/crio-b1ebf4d10d3ee564f83f9dcb13c331dac10d96ce2155ef486ce9a8d93d707761 WatchSource:0}: Error finding container b1ebf4d10d3ee564f83f9dcb13c331dac10d96ce2155ef486ce9a8d93d707761: Status 404 returned error can't find the container with id b1ebf4d10d3ee564f83f9dcb13c331dac10d96ce2155ef486ce9a8d93d707761
May 28 17:18:46.447266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.447231    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"b1ebf4d10d3ee564f83f9dcb13c331dac10d96ce2155ef486ce9a8d93d707761"}
May 28 17:18:46.448203 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.448176    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcmtr" event={"ID":"c3981277-d06e-4f2d-b134-ed4a720fcd50","Type":"ContainerStarted","Data":"628a9479e843e31c71b55a0e62659d56b83dcf6f28b2422367785f3ee2c16644"}
May 28 17:18:46.485792 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:46.485722    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"
May 28 17:18:47.211751 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.211320    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c"]
May 28 17:18:47.215760 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:47.215732    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8207f4fe_4045_4363_9f77_abc94b48520f.slice/crio-d0bfbb40999a327aa6795ddefcef109693ef1e5937af349f4f661681a45842a8 WatchSource:0}: Error finding container d0bfbb40999a327aa6795ddefcef109693ef1e5937af349f4f661681a45842a8: Status 404 returned error can't find the container with id d0bfbb40999a327aa6795ddefcef109693ef1e5937af349f4f661681a45842a8
May 28 17:18:47.452438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.452400    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c" event={"ID":"8207f4fe-4045-4363-9f77-abc94b48520f","Type":"ContainerStarted","Data":"d0bfbb40999a327aa6795ddefcef109693ef1e5937af349f4f661681a45842a8"}
May 28 17:18:47.454096 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.454063    2558 generic.go:358] "Generic (PLEG): container finished" podID="c3981277-d06e-4f2d-b134-ed4a720fcd50" containerID="0e64375f921244b43073e6f58520c109cfc4a546599e61651f59063cc96edac4" exitCode=0
May 28 17:18:47.454253 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.454164    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcmtr" event={"ID":"c3981277-d06e-4f2d-b134-ed4a720fcd50","Type":"ContainerDied","Data":"0e64375f921244b43073e6f58520c109cfc4a546599e61651f59063cc96edac4"}
May 28 17:18:47.456346 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.456317    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx" event={"ID":"b7c87324-d4a2-46b5-8407-e0331ec51f8d","Type":"ContainerStarted","Data":"072b2f67e5e66c344ab80a64d22ab890404191dbfdbff7a66393efca1372db77"}
May 28 17:18:47.490377 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.490323    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hxxkx" podStartSLOduration=1.781628999 podStartE2EDuration="3.490308062s" podCreationTimestamp="2026-05-28 17:18:44 +0000 UTC" firstStartedPulling="2026-05-28 17:18:45.351200904 +0000 UTC m=+56.732325863" lastFinishedPulling="2026-05-28 17:18:47.059879945 +0000 UTC m=+58.441004926" observedRunningTime="2026-05-28 17:18:47.489131944 +0000 UTC m=+58.870256927" watchObservedRunningTime="2026-05-28 17:18:47.490308062 +0000 UTC m=+58.871433045"
May 28 17:18:47.737004 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.736973    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b64bfdf95-xbndv"]
May 28 17:18:47.752589 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.752563    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b64bfdf95-xbndv"]
May 28 17:18:47.752706 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.752700    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.755589 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755555    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 17:18:47.755720 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755662    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 17:18:47.755720 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755687    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-am9lvhm0be1s3\""
May 28 17:18:47.755720 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755694    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 17:18:47.755871 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755817    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s698l\""
May 28 17:18:47.755958 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.755945    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 17:18:47.756056 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.756039    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 17:18:47.767526 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-grpc-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8j8w\" (UniqueName: \"kubernetes.io/projected/d69455c1-9b8c-4c03-8605-22abcce72ba7-kube-api-access-c8j8w\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767832 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767832 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69455c1-9b8c-4c03-8605-22abcce72ba7-metrics-client-ca\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.767832 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.767767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868286 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868254    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8j8w\" (UniqueName: \"kubernetes.io/projected/d69455c1-9b8c-4c03-8605-22abcce72ba7-kube-api-access-c8j8w\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868299    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868326    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69455c1-9b8c-4c03-8605-22abcce72ba7-metrics-client-ca\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868359    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868569 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868434    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868569 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868478    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-grpc-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.868569 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868507    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.869001 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.868826    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.869445 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.869364    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69455c1-9b8c-4c03-8605-22abcce72ba7-metrics-client-ca\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871307 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871284    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871521    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871618 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871567    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-grpc-tls\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871691 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871669    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871744 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871702    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.871795 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.871757    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69455c1-9b8c-4c03-8605-22abcce72ba7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.875744 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.875724    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8j8w\" (UniqueName: \"kubernetes.io/projected/d69455c1-9b8c-4c03-8605-22abcce72ba7-kube-api-access-c8j8w\") pod \"thanos-querier-b64bfdf95-xbndv\" (UID: \"d69455c1-9b8c-4c03-8605-22abcce72ba7\") " pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:47.965508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.965417    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-k47d8"]
May 28 17:18:47.982703 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.982663    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k47d8"]
May 28 17:18:47.982879 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.982810    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:18:47.985681 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.985453    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 17:18:47.985681 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.985575    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 17:18:47.985952 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:47.985742    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sqctw\""
May 28 17:18:48.061299 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.061276    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:48.071493 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.071460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ks7z\" (UniqueName: \"kubernetes.io/projected/21cf659d-5356-491b-96ad-1343ec8fb9b6-kube-api-access-2ks7z\") pod \"downloads-57bd96b888-k47d8\" (UID: \"21cf659d-5356-491b-96ad-1343ec8fb9b6\") " pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:18:48.172879 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.172843    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ks7z\" (UniqueName: \"kubernetes.io/projected/21cf659d-5356-491b-96ad-1343ec8fb9b6-kube-api-access-2ks7z\") pod \"downloads-57bd96b888-k47d8\" (UID: \"21cf659d-5356-491b-96ad-1343ec8fb9b6\") " pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:18:48.181347 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.181318    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ks7z\" (UniqueName: \"kubernetes.io/projected/21cf659d-5356-491b-96ad-1343ec8fb9b6-kube-api-access-2ks7z\") pod \"downloads-57bd96b888-k47d8\" (UID: \"21cf659d-5356-491b-96ad-1343ec8fb9b6\") " pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:18:48.210951 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.210901    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b64bfdf95-xbndv"]
May 28 17:18:48.215688 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:48.215626    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69455c1_9b8c_4c03_8605_22abcce72ba7.slice/crio-904a240f0ea5b066e72f09db8f51215fbaf944f851e080a8d2a8214e39f64fec WatchSource:0}: Error finding container 904a240f0ea5b066e72f09db8f51215fbaf944f851e080a8d2a8214e39f64fec: Status 404 returned error can't find the container with id 904a240f0ea5b066e72f09db8f51215fbaf944f851e080a8d2a8214e39f64fec
May 28 17:18:48.295226 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.295197    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:18:48.383410 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.383378    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5mhs"
May 28 17:18:48.422677 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.422646    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cvcq9"
May 28 17:18:48.438821 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.438787    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k47d8"]
May 28 17:18:48.461226 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.461184    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"904a240f0ea5b066e72f09db8f51215fbaf944f851e080a8d2a8214e39f64fec"}
May 28 17:18:48.463086 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.463052    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde" exitCode=0
May 28 17:18:48.463217 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.463130    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"}
May 28 17:18:48.465879 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.465811    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcmtr" event={"ID":"c3981277-d06e-4f2d-b134-ed4a720fcd50","Type":"ContainerStarted","Data":"e5c5d8bc8f52d66cc6d79ca76b37804b773702ec7130ef76889227b18397ce63"}
May 28 17:18:48.465879 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.465862    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcmtr" event={"ID":"c3981277-d06e-4f2d-b134-ed4a720fcd50","Type":"ContainerStarted","Data":"00d84e0e9d1594c72a6c54b09bc7470790f0a3a06a947725f79f65a8d0d05c75"}
May 28 17:18:48.506509 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:48.506457    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qcmtr" podStartSLOduration=3.059530217 podStartE2EDuration="4.506442195s" podCreationTimestamp="2026-05-28 17:18:44 +0000 UTC" firstStartedPulling="2026-05-28 17:18:45.618145856 +0000 UTC m=+56.999270816" lastFinishedPulling="2026-05-28 17:18:47.065057834 +0000 UTC m=+58.446182794" observedRunningTime="2026-05-28 17:18:48.505993488 +0000 UTC m=+59.887118469" watchObservedRunningTime="2026-05-28 17:18:48.506442195 +0000 UTC m=+59.887567174"
May 28 17:18:48.695214 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:48.695183    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cf659d_5356_491b_96ad_1343ec8fb9b6.slice/crio-05faedf69a1b4d83b1ce7822b90a325df979099596df92c30d0f53fda667fe72 WatchSource:0}: Error finding container 05faedf69a1b4d83b1ce7822b90a325df979099596df92c30d0f53fda667fe72: Status 404 returned error can't find the container with id 05faedf69a1b4d83b1ce7822b90a325df979099596df92c30d0f53fda667fe72
May 28 17:18:49.164982 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.164952    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7dc9555ff-75srm"]
May 28 17:18:49.180863 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.179969    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.185683    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mvbsv\""
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.185743    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.185970    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.186172    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.186500    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 17:18:49.189315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.187453    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-36ilhjfp461vd\""
May 28 17:18:49.195320 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.191746    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7dc9555ff-75srm"]
May 28 17:18:49.290061 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.290028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-metrics-server-audit-profiles\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.290604 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.290580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-tls\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.290775 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.290755    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.290996 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.290969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-client-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.291156 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.291141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jn78\" (UniqueName: \"kubernetes.io/projected/614b9213-87eb-4823-9370-c32793b143ac-kube-api-access-4jn78\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.291269 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.291255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-client-certs\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.291383 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.291371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/614b9213-87eb-4823-9370-c32793b143ac-audit-log\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393047    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-metrics-server-audit-profiles\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393095    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-tls\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393143    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393203    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-client-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393244    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn78\" (UniqueName: \"kubernetes.io/projected/614b9213-87eb-4823-9370-c32793b143ac-kube-api-access-4jn78\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393277    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-client-certs\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.393426 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.393315    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/614b9213-87eb-4823-9370-c32793b143ac-audit-log\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.394867 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.394120    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-metrics-server-audit-profiles\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.394867 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.394182    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/614b9213-87eb-4823-9370-c32793b143ac-audit-log\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.394867 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.394610    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614b9213-87eb-4823-9370-c32793b143ac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.396814 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.396787    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-client-ca-bundle\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.398746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.398696    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-tls\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.400950 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.400887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/614b9213-87eb-4823-9370-c32793b143ac-secret-metrics-server-client-certs\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.410341 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.410298    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn78\" (UniqueName: \"kubernetes.io/projected/614b9213-87eb-4823-9370-c32793b143ac-kube-api-access-4jn78\") pod \"metrics-server-7dc9555ff-75srm\" (UID: \"614b9213-87eb-4823-9370-c32793b143ac\") " pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.432901 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.432822    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"]
May 28 17:18:49.435854 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.435833    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:49.442824 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.442765    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-tk75g\""
May 28 17:18:49.443116 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.443098    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 17:18:49.445367 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.445345    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"]
May 28 17:18:49.474031 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.473820    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c" event={"ID":"8207f4fe-4045-4363-9f77-abc94b48520f","Type":"ContainerStarted","Data":"b77f11d228d68395bf9e7d1e8d5053715e80b5bab249f82dab51e7fc4019f59a"}
May 28 17:18:49.474031 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.473874    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c" event={"ID":"8207f4fe-4045-4363-9f77-abc94b48520f","Type":"ContainerStarted","Data":"2d3a3f8947f51ad297e33db74848b786d2c5b7d917fe1a95c144ea682de29527"}
May 28 17:18:49.474031 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.473891    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c" event={"ID":"8207f4fe-4045-4363-9f77-abc94b48520f","Type":"ContainerStarted","Data":"7d929cea4454b28305d70db5195461b10bf9f071309eb89b56269fa4e0fea52b"}
May 28 17:18:49.475706 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.475674    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k47d8" event={"ID":"21cf659d-5356-491b-96ad-1343ec8fb9b6","Type":"ContainerStarted","Data":"05faedf69a1b4d83b1ce7822b90a325df979099596df92c30d0f53fda667fe72"}
May 28 17:18:49.493130 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.492797    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wj48c" podStartSLOduration=3.994256966 podStartE2EDuration="5.492779072s" podCreationTimestamp="2026-05-28 17:18:44 +0000 UTC" firstStartedPulling="2026-05-28 17:18:47.218454047 +0000 UTC m=+58.599579011" lastFinishedPulling="2026-05-28 17:18:48.716976156 +0000 UTC m=+60.098101117" observedRunningTime="2026-05-28 17:18:49.490578771 +0000 UTC m=+60.871703754" watchObservedRunningTime="2026-05-28 17:18:49.492779072 +0000 UTC m=+60.873904055"
May 28 17:18:49.496294 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.494736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cd271b8-d79d-4892-abf1-c322b34137ab-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gnk9j\" (UID: \"2cd271b8-d79d-4892-abf1-c322b34137ab\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:49.510021 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.509982    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:18:49.596146 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.595653    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cd271b8-d79d-4892-abf1-c322b34137ab-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gnk9j\" (UID: \"2cd271b8-d79d-4892-abf1-c322b34137ab\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:49.600494 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.600432    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cd271b8-d79d-4892-abf1-c322b34137ab-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gnk9j\" (UID: \"2cd271b8-d79d-4892-abf1-c322b34137ab\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:49.675219 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.675104    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7dc9555ff-75srm"]
May 28 17:18:49.750258 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.750146    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:49.875362 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.872899    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-575b559fbd-v86zz"]
May 28 17:18:49.879724 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.879696    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.883198 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.883169    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 17:18:49.883341 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.883320    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 17:18:49.883668 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.883339    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 17:18:49.883830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.883811    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 17:18:49.883899 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.883832    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 17:18:49.884099 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.884072    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sbfns\""
May 28 17:18:49.890725 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.890702    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 17:18:49.891894 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.891875    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-575b559fbd-v86zz"]
May 28 17:18:49.999131 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-metrics-client-ca\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999294 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-federate-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999294 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999294 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-serving-certs-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999499 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999499 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999499 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:49.999499 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:49.999472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ntk\" (UniqueName: \"kubernetes.io/projected/55573284-4fd6-4fd8-97a5-d033b5660f2c-kube-api-access-t8ntk\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.069373 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:50.069331    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614b9213_87eb_4823_9370_c32793b143ac.slice/crio-390e075efb3a1ae3df8f6cc96d6c52916e51b66ebc2d45daaea30107eb06ee7b WatchSource:0}: Error finding container 390e075efb3a1ae3df8f6cc96d6c52916e51b66ebc2d45daaea30107eb06ee7b: Status 404 returned error can't find the container with id 390e075efb3a1ae3df8f6cc96d6c52916e51b66ebc2d45daaea30107eb06ee7b
May 28 17:18:50.100371 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100316    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100521 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100442    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100521 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100471    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100521 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100504    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ntk\" (UniqueName: \"kubernetes.io/projected/55573284-4fd6-4fd8-97a5-d033b5660f2c-kube-api-access-t8ntk\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100692 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100561    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-metrics-client-ca\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100692 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100598    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-federate-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100692 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100627    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.100692 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.100668    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-serving-certs-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.101401 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.101349    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-serving-certs-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.101878 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.101825    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-metrics-client-ca\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.102113 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.102069    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.104268 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.104225    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.104364 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.104322    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.104983 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.104960    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-federate-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.106124 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.106101    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55573284-4fd6-4fd8-97a5-d033b5660f2c-telemeter-client-tls\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.109191 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.109145    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ntk\" (UniqueName: \"kubernetes.io/projected/55573284-4fd6-4fd8-97a5-d033b5660f2c-kube-api-access-t8ntk\") pod \"telemeter-client-575b559fbd-v86zz\" (UID: \"55573284-4fd6-4fd8-97a5-d033b5660f2c\") " pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.193689 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.193316    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz"
May 28 17:18:50.221465 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.221414    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"]
May 28 17:18:50.480945 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.480833    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm" event={"ID":"614b9213-87eb-4823-9370-c32793b143ac","Type":"ContainerStarted","Data":"390e075efb3a1ae3df8f6cc96d6c52916e51b66ebc2d45daaea30107eb06ee7b"}
May 28 17:18:50.482892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.482844    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"}
May 28 17:18:50.814053 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:50.814012    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd271b8_d79d_4892_abf1_c322b34137ab.slice/crio-0e79185321f81bb967700177230ca99023bd2fda490a77c786a1d25e20f1627c WatchSource:0}: Error finding container 0e79185321f81bb967700177230ca99023bd2fda490a77c786a1d25e20f1627c: Status 404 returned error can't find the container with id 0e79185321f81bb967700177230ca99023bd2fda490a77c786a1d25e20f1627c
May 28 17:18:50.874846 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.872791    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:18:50.876684 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.876659    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.879804 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.879458    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 17:18:50.879951 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.879891    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-czx2l\""
May 28 17:18:50.881025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.880186    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 17:18:50.881025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.880441    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 17:18:50.881025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.880644    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 17:18:50.881025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.880833    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 17:18:50.884186 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.882728    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 17:18:50.884186 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.882989    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 17:18:50.884186 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.883195    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 17:18:50.887558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.886011    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 17:18:50.887558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.886270    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 17:18:50.887558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.886712    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9k7kutl1hsdc2\""
May 28 17:18:50.893174 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.892148    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 17:18:50.893956 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.893936    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 17:18:50.896487 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.896320    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:18:50.908634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908479    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9jm\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.908987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.908983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.909567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.909007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.909567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.909055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:50.909567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:50.909128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.008544 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.008509    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-575b559fbd-v86zz"]
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010318    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010374    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010402    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9jm\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010444    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010475    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010500    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010530    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010553    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010581    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010618    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010644    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010670    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010696    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010717    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010757    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010794    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010888    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012868 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.010937    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012868 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.011584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.012868 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.011969    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.014914 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.013645    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.014914 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.014738    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.016081 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.016055    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.019622 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.019595    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.025218    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.025593    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.026018    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.026341    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.026767    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027313 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.027119    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.027655 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.027356    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9jm\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.028633 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.028582    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.029075 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.028857    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.029207 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.029181    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.029715 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.029677    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.030213 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.030178    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.223479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.220709    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:18:51.400648 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.400548    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:18:51.403848 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:51.403815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a97d9a_f36c_4d7e_b1f2_45d070943ab0.slice/crio-a1ddecf8bfc8f66d4caeaf76c05dce77c3e2f898b4cb85c2b457e7571c53f2e7 WatchSource:0}: Error finding container a1ddecf8bfc8f66d4caeaf76c05dce77c3e2f898b4cb85c2b457e7571c53f2e7: Status 404 returned error can't find the container with id a1ddecf8bfc8f66d4caeaf76c05dce77c3e2f898b4cb85c2b457e7571c53f2e7
May 28 17:18:51.491587 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.491543    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz" event={"ID":"55573284-4fd6-4fd8-97a5-d033b5660f2c","Type":"ContainerStarted","Data":"39f2ebaa9652993ee5787569bd73f562e0b9bb4694597b995f7bb0bfeb9dc5eb"}
May 28 17:18:51.495729 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.495695    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"65cd46c602640b5a0704eb4a4c57ad574638ca0799cde9bcbf530187586f17d3"}
May 28 17:18:51.495862 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.495734    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"8728459e2fab768690d37b8e1957731701db3896d55be0effe7dbe2191b245df"}
May 28 17:18:51.495862 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.495750    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"e6a7c979b2ddf960cc53dae4c52288bab70aa059be67afc4905efa8b0a78e06e"}
May 28 17:18:51.499001 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.498933    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j" event={"ID":"2cd271b8-d79d-4892-abf1-c322b34137ab","Type":"ContainerStarted","Data":"0e79185321f81bb967700177230ca99023bd2fda490a77c786a1d25e20f1627c"}
May 28 17:18:51.503405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.503227    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"}
May 28 17:18:51.503405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.503327    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"}
May 28 17:18:51.503405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.503344    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"}
May 28 17:18:51.503405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.503357    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"}
May 28 17:18:51.507439 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:51.507412    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"a1ddecf8bfc8f66d4caeaf76c05dce77c3e2f898b4cb85c2b457e7571c53f2e7"}
May 28 17:18:52.512610 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:52.512571    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47" exitCode=0
May 28 17:18:52.513005 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:52.512661    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"}
May 28 17:18:54.522106 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.522049    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm" event={"ID":"614b9213-87eb-4823-9370-c32793b143ac","Type":"ContainerStarted","Data":"47893abeaaf03f93b2b8ed5542079b1d4d35c50132edeef5eb040d4a03fc5b72"}
May 28 17:18:54.524788 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.524753    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz" event={"ID":"55573284-4fd6-4fd8-97a5-d033b5660f2c","Type":"ContainerStarted","Data":"deec9a20272a8f8512b4740065f626115a8f204c9336fa36cec0dd0bbfe38e59"}
May 28 17:18:54.524961 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.524798    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz" event={"ID":"55573284-4fd6-4fd8-97a5-d033b5660f2c","Type":"ContainerStarted","Data":"9ddb37f3f573d70802cc701736c433925fd3d59f7d654743bd60907f7aa33321"}
May 28 17:18:54.524961 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.524813    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz" event={"ID":"55573284-4fd6-4fd8-97a5-d033b5660f2c","Type":"ContainerStarted","Data":"d1c8f8d9eaed51bd2cfc671f86263911d1cdbfdb23f769e7325d345fd7bb7206"}
May 28 17:18:54.530911 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.530824    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"583aa3ee24d772476529b33cf365e53b348763e2bd2d52fa651cd90481b94583"}
May 28 17:18:54.530911 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.530871    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"fb372c0bbcb8c620611625c45d9a2bf16ccdb771039873f1f3e5bebf8555b969"}
May 28 17:18:54.530911 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.530888    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" event={"ID":"d69455c1-9b8c-4c03-8605-22abcce72ba7","Type":"ContainerStarted","Data":"d15ea63a8ffb9c62f655917840e39d630c2d1b21d8f5a4b040185d3004e38de3"}
May 28 17:18:54.531130 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.531082    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:18:54.532912 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.532887    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j" event={"ID":"2cd271b8-d79d-4892-abf1-c322b34137ab","Type":"ContainerStarted","Data":"84049667080a32dc56e0d21a77ed79298e7bbce73a9b0599b57ce4fbf097cf82"}
May 28 17:18:54.535042 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.533610    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:54.539999 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.539885    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j"
May 28 17:18:54.541461 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.541413    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm" podStartSLOduration=2.105973232 podStartE2EDuration="5.541398353s" podCreationTimestamp="2026-05-28 17:18:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:50.072832931 +0000 UTC m=+61.453957895" lastFinishedPulling="2026-05-28 17:18:53.508258044 +0000 UTC m=+64.889383016" observedRunningTime="2026-05-28 17:18:54.539129479 +0000 UTC m=+65.920254466" watchObservedRunningTime="2026-05-28 17:18:54.541398353 +0000 UTC m=+65.922523335"
May 28 17:18:54.542824 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.542493    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerStarted","Data":"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"}
May 28 17:18:54.559854 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.559792    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-575b559fbd-v86zz" podStartSLOduration=3.065280694 podStartE2EDuration="5.559775771s" podCreationTimestamp="2026-05-28 17:18:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:51.020843065 +0000 UTC m=+62.401968025" lastFinishedPulling="2026-05-28 17:18:53.515338135 +0000 UTC m=+64.896463102" observedRunningTime="2026-05-28 17:18:54.557214819 +0000 UTC m=+65.938339802" watchObservedRunningTime="2026-05-28 17:18:54.559775771 +0000 UTC m=+65.940900790"
May 28 17:18:54.580203 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.580158    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv" podStartSLOduration=2.290482946 podStartE2EDuration="7.580143229s" podCreationTimestamp="2026-05-28 17:18:47 +0000 UTC" firstStartedPulling="2026-05-28 17:18:48.218373401 +0000 UTC m=+59.599498360" lastFinishedPulling="2026-05-28 17:18:53.508033676 +0000 UTC m=+64.889158643" observedRunningTime="2026-05-28 17:18:54.578825441 +0000 UTC m=+65.959950434" watchObservedRunningTime="2026-05-28 17:18:54.580143229 +0000 UTC m=+65.961268211"
May 28 17:18:54.593732 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.593680    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gnk9j" podStartSLOduration=2.900276973 podStartE2EDuration="5.593663563s" podCreationTimestamp="2026-05-28 17:18:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:50.816885944 +0000 UTC m=+62.198010926" lastFinishedPulling="2026-05-28 17:18:53.510272542 +0000 UTC m=+64.891397516" observedRunningTime="2026-05-28 17:18:54.592086317 +0000 UTC m=+65.973211299" watchObservedRunningTime="2026-05-28 17:18:54.593663563 +0000 UTC m=+65.974788546"
May 28 17:18:54.624467 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.620074    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.537022996 podStartE2EDuration="9.620055085s" podCreationTimestamp="2026-05-28 17:18:45 +0000 UTC" firstStartedPulling="2026-05-28 17:18:46.424579343 +0000 UTC m=+57.805704304" lastFinishedPulling="2026-05-28 17:18:53.507611421 +0000 UTC m=+64.888736393" observedRunningTime="2026-05-28 17:18:54.617401967 +0000 UTC m=+65.998526953" watchObservedRunningTime="2026-05-28 17:18:54.620055085 +0000 UTC m=+66.001180068"
May 28 17:18:54.957824 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.957772    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:54.958019 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.957834    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:54.960726 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.960700    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:18:54.960868 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.960756    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:18:54.971711 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.971675    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:18:54.971856 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.971826    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40c24b68-d3f8-492f-a456-00027745fff5-metrics-certs\") pod \"network-metrics-daemon-jntd7\" (UID: \"40c24b68-d3f8-492f-a456-00027745fff5\") " pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:54.983344 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:54.983309    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ddk\" (UniqueName: \"kubernetes.io/projected/64659e81-2211-4d05-8ed0-f60e4c601970-kube-api-access-59ddk\") pod \"network-check-target-xgsr5\" (UID: \"64659e81-2211-4d05-8ed0-f60e4c601970\") " pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:55.044458 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.043054    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9td\""
May 28 17:18:55.046591 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.046530    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5snq\""
May 28 17:18:55.051605 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.051548    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:18:55.055082 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.054394    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jntd7"
May 28 17:18:55.247699 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.247293    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jntd7"]
May 28 17:18:55.275504 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:55.275461    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xgsr5"]
May 28 17:18:56.422529 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:56.422487    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c24b68_d3f8_492f_a456_00027745fff5.slice/crio-a727074902d5d33818bab4f7e1c84c668387ecc849490ae546426d75226ea800 WatchSource:0}: Error finding container a727074902d5d33818bab4f7e1c84c668387ecc849490ae546426d75226ea800: Status 404 returned error can't find the container with id a727074902d5d33818bab4f7e1c84c668387ecc849490ae546426d75226ea800
May 28 17:18:56.423377 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:18:56.423037    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64659e81_2211_4d05_8ed0_f60e4c601970.slice/crio-bcd6f5ae21dcaaa2ef55277dc38d610f2d776a2b0c5d06c395558f91040ed4c9 WatchSource:0}: Error finding container bcd6f5ae21dcaaa2ef55277dc38d610f2d776a2b0c5d06c395558f91040ed4c9: Status 404 returned error can't find the container with id bcd6f5ae21dcaaa2ef55277dc38d610f2d776a2b0c5d06c395558f91040ed4c9
May 28 17:18:56.559434 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:56.559399    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jntd7" event={"ID":"40c24b68-d3f8-492f-a456-00027745fff5","Type":"ContainerStarted","Data":"a727074902d5d33818bab4f7e1c84c668387ecc849490ae546426d75226ea800"}
May 28 17:18:56.562985 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:56.562953    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"}
May 28 17:18:56.565312 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:56.565287    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xgsr5" event={"ID":"64659e81-2211-4d05-8ed0-f60e4c601970","Type":"ContainerStarted","Data":"bcd6f5ae21dcaaa2ef55277dc38d610f2d776a2b0c5d06c395558f91040ed4c9"}
May 28 17:18:57.576420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.576383    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"}
May 28 17:18:57.576905 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.576429    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"}
May 28 17:18:57.576905 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.576443    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"}
May 28 17:18:57.576905 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.576456    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"}
May 28 17:18:57.576905 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.576470    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerStarted","Data":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"}
May 28 17:18:57.607559 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:57.607492    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.6469799590000003 podStartE2EDuration="7.607472681s" podCreationTimestamp="2026-05-28 17:18:50 +0000 UTC" firstStartedPulling="2026-05-28 17:18:52.514328647 +0000 UTC m=+63.895453648" lastFinishedPulling="2026-05-28 17:18:56.474821396 +0000 UTC m=+67.855946370" observedRunningTime="2026-05-28 17:18:57.603637023 +0000 UTC m=+68.984762017" watchObservedRunningTime="2026-05-28 17:18:57.607472681 +0000 UTC m=+68.988597663"
May 28 17:18:58.583064 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:58.583015    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jntd7" event={"ID":"40c24b68-d3f8-492f-a456-00027745fff5","Type":"ContainerStarted","Data":"569655f3c68078cbf35a432256f2a3e12a3f58c1d504886edf55e7a9ac3e6d8b"}
May 28 17:18:58.583064 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:58.583063    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jntd7" event={"ID":"40c24b68-d3f8-492f-a456-00027745fff5","Type":"ContainerStarted","Data":"5bcf9c060e6a27118e419e243f8757a95863c4991b629261d83ac948da9a442d"}
May 28 17:18:58.601003 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:18:58.600809    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jntd7" podStartSLOduration=68.374573613 podStartE2EDuration="1m9.600790473s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:56.425262663 +0000 UTC m=+67.806387625" lastFinishedPulling="2026-05-28 17:18:57.651479518 +0000 UTC m=+69.032604485" observedRunningTime="2026-05-28 17:18:58.598529487 +0000 UTC m=+69.979654470" watchObservedRunningTime="2026-05-28 17:18:58.600790473 +0000 UTC m=+69.981915458"
May 28 17:19:00.553869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:00.553838    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b64bfdf95-xbndv"
May 28 17:19:00.593501 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:00.593450    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xgsr5" event={"ID":"64659e81-2211-4d05-8ed0-f60e4c601970","Type":"ContainerStarted","Data":"880ab19b754e321925f91ac0a41b4dfc018cb16d4bfc74a5a920c2697f5bee1a"}
May 28 17:19:00.593844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:00.593679    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:19:00.608867 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:00.608675    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xgsr5" podStartSLOduration=68.343463089 podStartE2EDuration="1m11.608660157s" podCreationTimestamp="2026-05-28 17:17:49 +0000 UTC" firstStartedPulling="2026-05-28 17:18:56.425524934 +0000 UTC m=+67.806649900" lastFinishedPulling="2026-05-28 17:18:59.690722002 +0000 UTC m=+71.071846968" observedRunningTime="2026-05-28 17:19:00.608409854 +0000 UTC m=+71.989534834" watchObservedRunningTime="2026-05-28 17:19:00.608660157 +0000 UTC m=+71.989785178"
May 28 17:19:01.223117 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:01.222985    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:07.619143 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:07.619053    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k47d8" event={"ID":"21cf659d-5356-491b-96ad-1343ec8fb9b6","Type":"ContainerStarted","Data":"4f90beb35f9452de43197eae266172a65b1d5bfed3a95b1af15898a6f0805a08"}
May 28 17:19:07.619610 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:07.619271    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:19:07.631241 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:07.631200    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-k47d8"
May 28 17:19:07.638800 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:07.638753    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-k47d8" podStartSLOduration=2.030493316 podStartE2EDuration="20.638738509s" podCreationTimestamp="2026-05-28 17:18:47 +0000 UTC" firstStartedPulling="2026-05-28 17:18:48.697204499 +0000 UTC m=+60.078329462" lastFinishedPulling="2026-05-28 17:19:07.30544968 +0000 UTC m=+78.686574655" observedRunningTime="2026-05-28 17:19:07.636260882 +0000 UTC m=+79.017385855" watchObservedRunningTime="2026-05-28 17:19:07.638738509 +0000 UTC m=+79.019863493"
May 28 17:19:09.510531 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:09.510486    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:19:09.510976 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:09.510549    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:19:29.515954 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:29.515903    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:19:29.520089 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:29.520064    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7dc9555ff-75srm"
May 28 17:19:31.599508 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:31.599479    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xgsr5"
May 28 17:19:51.222552 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:51.222514    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:51.288155 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:51.288126    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:51.772525 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:19:51.772500    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:04.976187 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976148    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:04.976780 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976735    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="alertmanager" containerID="cri-o://303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6" gracePeriod=120
May 28 17:20:04.976854 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976797    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-metric" containerID="cri-o://f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b" gracePeriod=120
May 28 17:20:04.976914 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976836    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-web" containerID="cri-o://5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243" gracePeriod=120
May 28 17:20:04.976914 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976814    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="prom-label-proxy" containerID="cri-o://825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3" gracePeriod=120
May 28 17:20:04.976914 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.976871    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="config-reloader" containerID="cri-o://ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9" gracePeriod=120
May 28 17:20:04.977185 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:04.977123    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy" containerID="cri-o://fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065" gracePeriod=120
May 28 17:20:05.799416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799385    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3" exitCode=0
May 28 17:20:05.799416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799411    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065" exitCode=0
May 28 17:20:05.799416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799417    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9" exitCode=0
May 28 17:20:05.799416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799423    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6" exitCode=0
May 28 17:20:05.799683 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799456    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"}
May 28 17:20:05.799683 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799489    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"}
May 28 17:20:05.799683 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799500    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"}
May 28 17:20:05.799683 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:05.799508    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"}
May 28 17:20:06.219436 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.219411    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:06.317078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317047    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317099    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317122    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317145    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317165    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcfkw\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317191    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317237 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317222    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317396    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317459    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317490    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317518    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317521    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:06.317804 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317542    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.317804 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.317623    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy\") pod \"7d0500f3-f748-4f8e-9264-77814cb6e909\" (UID: \"7d0500f3-f748-4f8e-9264-77814cb6e909\") "
May 28 17:20:06.318073 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.318050    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-metrics-client-ca\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.318186 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.318154    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:06.319084 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.319036    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:06.320008 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.319960    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.320329 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320231    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw" (OuterVolumeSpecName: "kube-api-access-bcfkw") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "kube-api-access-bcfkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:06.320329 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320254    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.320329 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320302    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out" (OuterVolumeSpecName: "config-out") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:06.320539 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320417    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:06.320954 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320902    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.320954 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320944    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.321113 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.320966    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume" (OuterVolumeSpecName: "config-volume") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.325709 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.325685    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.333014 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.332992    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config" (OuterVolumeSpecName: "web-config") pod "7d0500f3-f748-4f8e-9264-77814cb6e909" (UID: "7d0500f3-f748-4f8e-9264-77814cb6e909"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:06.418663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418624    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcfkw\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-kube-api-access-bcfkw\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418656    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418668    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418678    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-alertmanager-main-db\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418687    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-main-tls\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418697    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-cluster-tls-config\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418706    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-web-config\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418715    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-config-volume\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418723    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418733    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d0500f3-f748-4f8e-9264-77814cb6e909-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418742    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d0500f3-f748-4f8e-9264-77814cb6e909-config-out\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.418892 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.418750    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d0500f3-f748-4f8e-9264-77814cb6e909-tls-assets\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:06.805279 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805250    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b" exitCode=0
May 28 17:20:06.805279 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805274    2558 generic.go:358] "Generic (PLEG): container finished" podID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerID="5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243" exitCode=0
May 28 17:20:06.805528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805343    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"}
May 28 17:20:06.805528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805384    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"}
May 28 17:20:06.805528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805388    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:06.805528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805398    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d0500f3-f748-4f8e-9264-77814cb6e909","Type":"ContainerDied","Data":"b1ebf4d10d3ee564f83f9dcb13c331dac10d96ce2155ef486ce9a8d93d707761"}
May 28 17:20:06.805528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.805413    2558 scope.go:117] "RemoveContainer" containerID="825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"
May 28 17:20:06.813665 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.813645    2558 scope.go:117] "RemoveContainer" containerID="f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"
May 28 17:20:06.820940 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.820902    2558 scope.go:117] "RemoveContainer" containerID="fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"
May 28 17:20:06.827977 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.827951    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:06.828434 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.828416    2558 scope.go:117] "RemoveContainer" containerID="5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"
May 28 17:20:06.836276 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.836248    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:06.837429 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.837320    2558 scope.go:117] "RemoveContainer" containerID="ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"
May 28 17:20:06.844575 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.844559    2558 scope.go:117] "RemoveContainer" containerID="303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"
May 28 17:20:06.851286 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.851268    2558 scope.go:117] "RemoveContainer" containerID="5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"
May 28 17:20:06.858013 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.857989    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:06.858369 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858354    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="init-config-reloader"
May 28 17:20:06.858432 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858373    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="init-config-reloader"
May 28 17:20:06.858432 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858385    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="alertmanager"
May 28 17:20:06.858432 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858387    2558 scope.go:117] "RemoveContainer" containerID="825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858393    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="alertmanager"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858470    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858482    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858490    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="config-reloader"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858496    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="config-reloader"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858502    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-metric"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858507    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-metric"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858514    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="prom-label-proxy"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858519    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="prom-label-proxy"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858534    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-web"
May 28 17:20:06.858538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858542    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-web"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858629    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-web"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858641    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858651    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="alertmanager"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858659    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="config-reloader"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858665    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="kube-rbac-proxy-metric"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858671    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" containerName="prom-label-proxy"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.858697    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3\": container with ID starting with 825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3 not found: ID does not exist" containerID="825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858725    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"} err="failed to get container status \"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3\": rpc error: code = NotFound desc = could not find container \"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3\": container with ID starting with 825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3 not found: ID does not exist"
May 28 17:20:06.858882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.858770    2558 scope.go:117] "RemoveContainer" containerID="f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"
May 28 17:20:06.859284 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.858997    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b\": container with ID starting with f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b not found: ID does not exist" containerID="f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"
May 28 17:20:06.859284 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859034    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"} err="failed to get container status \"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b\": rpc error: code = NotFound desc = could not find container \"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b\": container with ID starting with f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b not found: ID does not exist"
May 28 17:20:06.859284 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859057    2558 scope.go:117] "RemoveContainer" containerID="fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"
May 28 17:20:06.859423 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.859319    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065\": container with ID starting with fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065 not found: ID does not exist" containerID="fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"
May 28 17:20:06.859423 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859351    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"} err="failed to get container status \"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065\": rpc error: code = NotFound desc = could not find container \"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065\": container with ID starting with fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065 not found: ID does not exist"
May 28 17:20:06.859423 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859378    2558 scope.go:117] "RemoveContainer" containerID="5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"
May 28 17:20:06.859660 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.859641    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243\": container with ID starting with 5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243 not found: ID does not exist" containerID="5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"
May 28 17:20:06.859707 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859666    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"} err="failed to get container status \"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243\": rpc error: code = NotFound desc = could not find container \"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243\": container with ID starting with 5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243 not found: ID does not exist"
May 28 17:20:06.859707 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859681    2558 scope.go:117] "RemoveContainer" containerID="ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"
May 28 17:20:06.859915 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.859891    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9\": container with ID starting with ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9 not found: ID does not exist" containerID="ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"
May 28 17:20:06.859994 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859913    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"} err="failed to get container status \"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9\": rpc error: code = NotFound desc = could not find container \"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9\": container with ID starting with ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9 not found: ID does not exist"
May 28 17:20:06.859994 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.859953    2558 scope.go:117] "RemoveContainer" containerID="303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"
May 28 17:20:06.860282 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.860246    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6\": container with ID starting with 303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6 not found: ID does not exist" containerID="303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"
May 28 17:20:06.860282 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860274    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"} err="failed to get container status \"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6\": rpc error: code = NotFound desc = could not find container \"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6\": container with ID starting with 303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6 not found: ID does not exist"
May 28 17:20:06.860402 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860295    2558 scope.go:117] "RemoveContainer" containerID="5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"
May 28 17:20:06.860574 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:06.860553    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde\": container with ID starting with 5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde not found: ID does not exist" containerID="5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"
May 28 17:20:06.860630 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860580    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"} err="failed to get container status \"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde\": rpc error: code = NotFound desc = could not find container \"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde\": container with ID starting with 5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde not found: ID does not exist"
May 28 17:20:06.860630 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860599    2558 scope.go:117] "RemoveContainer" containerID="825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"
May 28 17:20:06.860882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860855    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3"} err="failed to get container status \"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3\": rpc error: code = NotFound desc = could not find container \"825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3\": container with ID starting with 825f04d3bbbc7e8430b159ddd571f3499b447979863d8b513788d8c6b42f07b3 not found: ID does not exist"
May 28 17:20:06.860882 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.860882    2558 scope.go:117] "RemoveContainer" containerID="f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"
May 28 17:20:06.862811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.861800    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b"} err="failed to get container status \"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b\": rpc error: code = NotFound desc = could not find container \"f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b\": container with ID starting with f8ba10a3f4cf68dc68908a316835c0858293ed503b802bcc76259ca40046862b not found: ID does not exist"
May 28 17:20:06.862811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.861826    2558 scope.go:117] "RemoveContainer" containerID="fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"
May 28 17:20:06.862811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.862617    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065"} err="failed to get container status \"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065\": rpc error: code = NotFound desc = could not find container \"fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065\": container with ID starting with fd2d7c26481f48095c5bcf1d93966c80c25ae485eab07785b48eb1e80f1b3065 not found: ID does not exist"
May 28 17:20:06.862811 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.862638    2558 scope.go:117] "RemoveContainer" containerID="5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"
May 28 17:20:06.863113 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.862851    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243"} err="failed to get container status \"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243\": rpc error: code = NotFound desc = could not find container \"5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243\": container with ID starting with 5f4e137b6e9345e6abf580d61957e892bf05384378586994001a39cc88115243 not found: ID does not exist"
May 28 17:20:06.863113 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.862885    2558 scope.go:117] "RemoveContainer" containerID="ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"
May 28 17:20:06.863113 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863063    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:06.863260 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863159    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9"} err="failed to get container status \"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9\": rpc error: code = NotFound desc = could not find container \"ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9\": container with ID starting with ac4be606d54725c29584a3924b9a5617434b1f4048d48d4c81a56ac0cab7e2c9 not found: ID does not exist"
May 28 17:20:06.863260 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863184    2558 scope.go:117] "RemoveContainer" containerID="303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"
May 28 17:20:06.863511 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863490    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6"} err="failed to get container status \"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6\": rpc error: code = NotFound desc = could not find container \"303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6\": container with ID starting with 303ce4b43b9497aa996546b7a0aebae5e3afbaa32ee94f79f5f89aeb285720d6 not found: ID does not exist"
May 28 17:20:06.863598 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863513    2558 scope.go:117] "RemoveContainer" containerID="5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"
May 28 17:20:06.863805 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.863783    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde"} err="failed to get container status \"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde\": rpc error: code = NotFound desc = could not find container \"5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde\": container with ID starting with 5a870cd3c7184de15e36b770cb364208fdb2ce7d90e69eb184b22937db77bcde not found: ID does not exist"
May 28 17:20:06.866094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866077    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:20:06.866188 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866093    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:20:06.866188 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866077    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:20:06.866290 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866247    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:20:06.866290 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866263    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-b957n\""
May 28 17:20:06.866379 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866329    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:20:06.866596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866580    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:20:06.866662 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866579    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:20:06.866662 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.866581    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:20:06.877336 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.877218    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:20:06.878308 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:06.878285    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:07.023039 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8c55\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-kube-api-access-q8c55\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023039 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023262 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-config-out\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-config-volume\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.023554 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.023442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-web-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124668 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124550    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124668 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124609    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124726    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124782    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124829    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-config-out\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124858    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.124907 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124885    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124912    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-config-volume\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124965    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-web-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.124971    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125010    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8c55\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-kube-api-access-q8c55\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125340 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125239    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125340 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125282    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125340 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125310    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125948 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125615    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.125948 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.125629    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031363ed-83e1-4d47-b885-c38db41e7675-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.127702 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.127670    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.127955 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.127909    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128304 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128006    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128304 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128012    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031363ed-83e1-4d47-b885-c38db41e7675-config-out\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128304 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128080    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128459 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128441    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128514 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128446    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-config-volume\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.128514 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.128491    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-web-config\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.129593 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.129573    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031363ed-83e1-4d47-b885-c38db41e7675-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.133133 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.133112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8c55\" (UniqueName: \"kubernetes.io/projected/031363ed-83e1-4d47-b885-c38db41e7675-kube-api-access-q8c55\") pod \"alertmanager-main-0\" (UID: \"031363ed-83e1-4d47-b885-c38db41e7675\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.174265 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.174235    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:07.234591 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.234559    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d0500f3-f748-4f8e-9264-77814cb6e909" path="/var/lib/kubelet/pods/7d0500f3-f748-4f8e-9264-77814cb6e909/volumes"
May 28 17:20:07.307886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.307862    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:07.310353 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:20:07.310315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031363ed_83e1_4d47_b885_c38db41e7675.slice/crio-a7ce58322b79be95ea3cbb48b982d5edcc653354ae5c7f41641c647d205cf5fa WatchSource:0}: Error finding container a7ce58322b79be95ea3cbb48b982d5edcc653354ae5c7f41641c647d205cf5fa: Status 404 returned error can't find the container with id a7ce58322b79be95ea3cbb48b982d5edcc653354ae5c7f41641c647d205cf5fa
May 28 17:20:07.810384 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.810349    2558 generic.go:358] "Generic (PLEG): container finished" podID="031363ed-83e1-4d47-b885-c38db41e7675" containerID="c33c69e395adbd6b79d646b8c7d164dbfd2929549bed9867f17590da659e05f1" exitCode=0
May 28 17:20:07.810582 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.810398    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerDied","Data":"c33c69e395adbd6b79d646b8c7d164dbfd2929549bed9867f17590da659e05f1"}
May 28 17:20:07.810582 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:07.810418    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"a7ce58322b79be95ea3cbb48b982d5edcc653354ae5c7f41641c647d205cf5fa"}
May 28 17:20:08.817473 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817435    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"0417d39f5ac79c40caa8e64cc68b7000e7dfc3f6b49c0b1d4d60d8432a5008bc"}
May 28 17:20:08.817473 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817478    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"7bac4691af92cb0a9e3f10720035ba1aad5af2d0206e1fa3114f20e214eaf58c"}
May 28 17:20:08.817857 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817492    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"efdeef753f38502b55374b697509e1e5f2aed4e77e8d8f644a0013dbe3ecc996"}
May 28 17:20:08.817857 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817505    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"d65a8ad14c14141bce7b07e6172facedc1f4d980c859955bf8b479ed36a6f78a"}
May 28 17:20:08.817857 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817519    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"b4681b2904b64dedd7f0ce18a63dd531fbfd268f93a95a251aec1b224c4b4e64"}
May 28 17:20:08.817857 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.817532    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031363ed-83e1-4d47-b885-c38db41e7675","Type":"ContainerStarted","Data":"d1bf77548a33cba373cac4e5cc92d595110039f42086123636b6f63d128e977b"}
May 28 17:20:08.847216 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:08.847169    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.847154076 podStartE2EDuration="2.847154076s" podCreationTimestamp="2026-05-28 17:20:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:08.846358737 +0000 UTC m=+140.227483724" watchObservedRunningTime="2026-05-28 17:20:08.847154076 +0000 UTC m=+140.228279057"
May 28 17:20:09.206902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.206782    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207436    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="prometheus" containerID="cri-o://bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7" gracePeriod=600
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207470    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9" gracePeriod=600
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207517    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="thanos-sidecar" containerID="cri-o://c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b" gracePeriod=600
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207560    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy" containerID="cri-o://974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5" gracePeriod=600
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207502    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-web" containerID="cri-o://d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec" gracePeriod=600
May 28 17:20:09.207710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.207636    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="config-reloader" containerID="cri-o://a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7" gracePeriod=600
May 28 17:20:09.461477 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.461413    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.652600 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652565    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652613    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652643    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652684    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652712    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652740    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.652798 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652771    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652812    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.652841    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653546 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653265    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:09.653679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653588    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:09.653679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653649    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653794 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653691    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653794 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653721    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653794 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653758    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653794    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653828    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653869    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653905    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.653966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.653957    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j9jm\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm\") pod \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\" (UID: \"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0\") "
May 28 17:20:09.654218 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.654133    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:09.654269 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.654239    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.654269 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.654258    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.654370 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.654274    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.655642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.655266    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:09.655642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.655302    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.655642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.655449    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.655642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.655559    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.655642 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.655610    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.656078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.656043    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:09.656172 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.656145    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:09.656315 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.656284    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.656601 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.656572    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm" (OuterVolumeSpecName: "kube-api-access-4j9jm") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "kube-api-access-4j9jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:09.657178 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.657154    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out" (OuterVolumeSpecName: "config-out") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:09.657325 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.657304    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:09.657799 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.657778    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config" (OuterVolumeSpecName: "config") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.658234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.658214    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.658298 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.658233    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.667029 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.667010    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config" (OuterVolumeSpecName: "web-config") pod "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" (UID: "f3a97d9a-f36c-4d7e-b1f2-45d070943ab0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:09.755605 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755515    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-web-config\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755605 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755544    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-prometheus-k8s-db\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755605 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755561    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-metrics-client-ca\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755605 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755601    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755617    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755630    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j9jm\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-kube-api-access-4j9jm\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755647    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-kube-rbac-proxy\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755660    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755673    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-grpc-tls\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755685    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-metrics-client-certs\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755696    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config-out\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755709    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755721    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755736    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-config\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.755904 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.755747    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0-tls-assets\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:20:09.823232 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823199    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9" exitCode=0
May 28 17:20:09.823232 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823227    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5" exitCode=0
May 28 17:20:09.823232 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823234    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec" exitCode=0
May 28 17:20:09.823232 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823239    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b" exitCode=0
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823237    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823275    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823287    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823296    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823307    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823296    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823245    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7" exitCode=0
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823324    2558 generic.go:358] "Generic (PLEG): container finished" podID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7" exitCode=0
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823388    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823408    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3a97d9a-f36c-4d7e-b1f2-45d070943ab0","Type":"ContainerDied","Data":"a1ddecf8bfc8f66d4caeaf76c05dce77c3e2f898b4cb85c2b457e7571c53f2e7"}
May 28 17:20:09.823663 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.823308    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.833388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.832893    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.839623 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.839609    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.846420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.846381    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.847671 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.847646    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:09.853126 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.853106    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.857985 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.857962    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:09.860342 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.860330    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.866745 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.866720    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.872999 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.872983    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.873257 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.873238    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.873301 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873270    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.873301 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873291    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.873549 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.873532    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.873621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873558    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.873621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873606    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.873828 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.873813    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.873888 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873835    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.873888 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.873857    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.874131 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.874113    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.874182 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874136    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.874182 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874151    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.874377 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.874363    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.874419 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874382    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.874419 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874394    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.874622 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.874608    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.874667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874623    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.874667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874633    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.874856 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:20:09.874840    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.874898 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874863    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.874898 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.874879    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.875160 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875144    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.875207 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875161    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.875346 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875330    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.875389 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875347    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.875555 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875536    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.875591 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875557    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.875746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875727    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.875746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875745    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.875902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875888    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.876030 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.875902    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.876118 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876101    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.876157 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876119    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.876306 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876287    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.876306 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876308    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.876473 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876458    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.876517 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876473    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.876650 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876622    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.876650 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876644    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.876839 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876820    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.876839 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.876839    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.877058 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877041    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.877097 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877058    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.877250 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877234    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.877250 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877249    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.877437 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877422    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.877478 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877437    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.877608 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877592    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.877608 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877606    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.877766 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877751    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.877803 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877765    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.878005 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.877980    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.878005 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878001    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.878243 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878226    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.878310 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878244    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.878445 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878428    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.878489 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878445    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.878635 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878616    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.878679 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878635    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.878861 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878843    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.878945 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.878863    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.879082 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879066    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.879129 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879084    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.879278 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879262    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.879323 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879279    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.879457 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879440    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.879496 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879460    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.879648 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879633    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.879696 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879649    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.879844 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879829    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.879884 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.879845    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.880067 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880025    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.880067 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880041    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.880353 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880330    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.880445 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880353    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.880757 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880624    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.880757 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.880675    2558 scope.go:117] "RemoveContainer" containerID="c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"
May 28 17:20:09.882089 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882066    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9"} err="failed to get container status \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": rpc error: code = NotFound desc = could not find container \"c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9\": container with ID starting with c65a0cc6871e89f140c7efe3f6690258d69661852c3fb5af28f9ae07bc6896b9 not found: ID does not exist"
May 28 17:20:09.882089 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882088    2558 scope.go:117] "RemoveContainer" containerID="974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"
May 28 17:20:09.882373 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882345    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5"} err="failed to get container status \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": rpc error: code = NotFound desc = could not find container \"974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5\": container with ID starting with 974fb2a472b4a705c4c8e1eb484d8abf895770cf6ae384b385bfea957dc3a9e5 not found: ID does not exist"
May 28 17:20:09.882446 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882388    2558 scope.go:117] "RemoveContainer" containerID="d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"
May 28 17:20:09.882674 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882642    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec"} err="failed to get container status \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": rpc error: code = NotFound desc = could not find container \"d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec\": container with ID starting with d03b5acbef720668fc2de5cdbd167cd66e7f2304f68f773d8303b54e4f3b14ec not found: ID does not exist"
May 28 17:20:09.882674 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882669    2558 scope.go:117] "RemoveContainer" containerID="c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"
May 28 17:20:09.882859 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882832    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:09.882970 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882884    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b"} err="failed to get container status \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": rpc error: code = NotFound desc = could not find container \"c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b\": container with ID starting with c04e1bbcdec9754eaabed3e65123f2e01f36dd29756b75ab9540017090ddba4b not found: ID does not exist"
May 28 17:20:09.882970 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.882900    2558 scope.go:117] "RemoveContainer" containerID="a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"
May 28 17:20:09.883120 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883098    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7"} err="failed to get container status \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": rpc error: code = NotFound desc = could not find container \"a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7\": container with ID starting with a76b9138ddba32309438e69fac1750c9215866dd8d623624333ef19dab856bc7 not found: ID does not exist"
May 28 17:20:09.883180 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883121    2558 scope.go:117] "RemoveContainer" containerID="bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"
May 28 17:20:09.883276 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883256    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-web"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883278    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-web"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883299    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="config-reloader"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883307    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="config-reloader"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883320    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="thanos-sidecar"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883330    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="thanos-sidecar"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883338    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883347    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy"
May 28 17:20:09.883361 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883358    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-thanos"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883366    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-thanos"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883330    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7"} err="failed to get container status \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": rpc error: code = NotFound desc = could not find container \"bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7\": container with ID starting with bf24a6527c88704f11bbac091710e82184d74e0378ae06b4243c08b4c134d4a7 not found: ID does not exist"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883385    2558 scope.go:117] "RemoveContainer" containerID="903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883388    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="prometheus"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883397    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="prometheus"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883410    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="init-config-reloader"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883418    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="init-config-reloader"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883490    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-web"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883503    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="config-reloader"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883512    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883522    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="prometheus"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883532    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="thanos-sidecar"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883544    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" containerName="kube-rbac-proxy-thanos"
May 28 17:20:09.883646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.883624    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47"} err="failed to get container status \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": rpc error: code = NotFound desc = could not find container \"903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47\": container with ID starting with 903bca2e09299e232d2466cac8d42bbfe7aae3aaf1c8d1eea345b4e4f616ce47 not found: ID does not exist"
May 28 17:20:09.887105 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.887089    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.889823 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.889806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9k7kutl1hsdc2\""
May 28 17:20:09.892075 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892060    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 17:20:09.892447 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892375    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 17:20:09.892577 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892446    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 17:20:09.892577 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892462    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 17:20:09.892751 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892730    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 17:20:09.892832 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892776    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 17:20:09.892991 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.892976    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 17:20:09.893284 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.893266    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 17:20:09.893357 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.893267    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-czx2l\""
May 28 17:20:09.893744 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.893725    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 17:20:09.893900 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.893883    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 17:20:09.900868 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.900844    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 17:20:09.902305 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.902284    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 17:20:09.904739 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.904715    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:09.957945 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.957891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.957953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.957977    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.957999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958094 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgggf\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-kube-api-access-kgggf\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:09.958435 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:09.958412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059217 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059179    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059330 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059227    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059416 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059398    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059452 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059436    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059490 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059464    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059535 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059489    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059577 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059541    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059624 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059576    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059624 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059615    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059723 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059646    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059723 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059675    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059723 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059705    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059749    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059776    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059811    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.059869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059841    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgggf\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-kube-api-access-kgggf\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060101 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059884    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060101 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.059916    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060208 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.060100    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060208 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.060159    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060305 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.060272    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.060991 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.060961    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062358    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062430    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062518    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062537    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062634 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062620    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.062874 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062653    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.063009 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.062988    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.063390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.063369    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.064460 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.064439    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abd135ff-82c8-42ed-831f-60aab2c3ffb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.064706 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.064689    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.064883 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.064867    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.064931 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.064875    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abd135ff-82c8-42ed-831f-60aab2c3ffb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.065078 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.065062    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abd135ff-82c8-42ed-831f-60aab2c3ffb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.067938 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.067907    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgggf\" (UniqueName: \"kubernetes.io/projected/abd135ff-82c8-42ed-831f-60aab2c3ffb7-kube-api-access-kgggf\") pod \"prometheus-k8s-0\" (UID: \"abd135ff-82c8-42ed-831f-60aab2c3ffb7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.201767 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.201732    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:10.332192 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.332165    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:10.334650 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:20:10.334619    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd135ff_82c8_42ed_831f_60aab2c3ffb7.slice/crio-7f790c45f21c5874231d14ce31ac85ceecdd29a1b2e94d13434b51b731955d26 WatchSource:0}: Error finding container 7f790c45f21c5874231d14ce31ac85ceecdd29a1b2e94d13434b51b731955d26: Status 404 returned error can't find the container with id 7f790c45f21c5874231d14ce31ac85ceecdd29a1b2e94d13434b51b731955d26
May 28 17:20:10.827411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.827375    2558 generic.go:358] "Generic (PLEG): container finished" podID="abd135ff-82c8-42ed-831f-60aab2c3ffb7" containerID="aa9a29460c0840f33db6d86bc96a7e4736cdb523a51f214b99320cb2e265f6f9" exitCode=0
May 28 17:20:10.827871 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.827461    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerDied","Data":"aa9a29460c0840f33db6d86bc96a7e4736cdb523a51f214b99320cb2e265f6f9"}
May 28 17:20:10.827871 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:10.827496    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"7f790c45f21c5874231d14ce31ac85ceecdd29a1b2e94d13434b51b731955d26"}
May 28 17:20:11.238647 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.238609    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a97d9a-f36c-4d7e-b1f2-45d070943ab0" path="/var/lib/kubelet/pods/f3a97d9a-f36c-4d7e-b1f2-45d070943ab0/volumes"
May 28 17:20:11.834179 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834136    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"174432ad9308cbb56d545cff7803ff19754ab0ee6f269b3fca449174393aad39"}
May 28 17:20:11.834179 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834176    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"ea534bdd771f04e46e43f2789ed130c95b1beaba3659a27c51b1765704a59bd2"}
May 28 17:20:11.834179 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834186    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"12e9e19a87d1a98480b27c40ff4f8730c2acb4efaf73d505f923ae85392be07e"}
May 28 17:20:11.834612 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834195    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"ee755000765d8f601665254662ffa3c5d397e5750453993762b6327e541e0868"}
May 28 17:20:11.834612 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834204    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"418b02eaf19dd74a746a33312da01e8054ed5521c7ccd38e0392841b758f3774"}
May 28 17:20:11.834612 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.834212    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abd135ff-82c8-42ed-831f-60aab2c3ffb7","Type":"ContainerStarted","Data":"e8bcaa0607128eed8eeefadedd687aad2c43a87580aae5594b1dd5b586723ca4"}
May 28 17:20:11.865589 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:11.865539    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.865521861 podStartE2EDuration="2.865521861s" podCreationTimestamp="2026-05-28 17:20:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:11.859000241 +0000 UTC m=+143.240125224" watchObservedRunningTime="2026-05-28 17:20:11.865521861 +0000 UTC m=+143.246646843"
May 28 17:20:15.202008 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:15.201971    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:54.871611 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:54.871578    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mtkqn"]
May 28 17:20:54.874466 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:54.874449    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:54.876913 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:54.876898    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 17:20:54.880604 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:54.880573    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtkqn"]
May 28 17:20:55.061567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.061507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-kubelet-config\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.061567 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.061577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9291586b-6f53-4db8-8f2a-f6ec83727782-original-pull-secret\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.061792 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.061638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-dbus\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.162352 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.162259    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-kubelet-config\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.162352 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.162308    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9291586b-6f53-4db8-8f2a-f6ec83727782-original-pull-secret\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.162506 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.162391    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-kubelet-config\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.162506 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.162429    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-dbus\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.162597 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.162581    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9291586b-6f53-4db8-8f2a-f6ec83727782-dbus\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.164558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.164532    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9291586b-6f53-4db8-8f2a-f6ec83727782-original-pull-secret\") pod \"global-pull-secret-syncer-mtkqn\" (UID: \"9291586b-6f53-4db8-8f2a-f6ec83727782\") " pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.185623 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.185598    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtkqn"
May 28 17:20:55.310966 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.310942    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtkqn"]
May 28 17:20:55.313467 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:20:55.313437    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9291586b_6f53_4db8_8f2a_f6ec83727782.slice/crio-0cbffe501bed1dc0db935449592332a13a5e244fc83c8648f35c96796ebec309 WatchSource:0}: Error finding container 0cbffe501bed1dc0db935449592332a13a5e244fc83c8648f35c96796ebec309: Status 404 returned error can't find the container with id 0cbffe501bed1dc0db935449592332a13a5e244fc83c8648f35c96796ebec309
May 28 17:20:55.972780 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:55.972736    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtkqn" event={"ID":"9291586b-6f53-4db8-8f2a-f6ec83727782","Type":"ContainerStarted","Data":"0cbffe501bed1dc0db935449592332a13a5e244fc83c8648f35c96796ebec309"}
May 28 17:20:59.987119 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:20:59.987019    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtkqn" event={"ID":"9291586b-6f53-4db8-8f2a-f6ec83727782","Type":"ContainerStarted","Data":"2671ffa8e6a562dc371dfcc6c8a81f7fd4ff589b83527e34fb18c0664fa45655"}
May 28 17:21:00.003261 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:00.003214    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtkqn" podStartSLOduration=1.695617771 podStartE2EDuration="6.003198941s" podCreationTimestamp="2026-05-28 17:20:54 +0000 UTC" firstStartedPulling="2026-05-28 17:20:55.315134554 +0000 UTC m=+186.696259513" lastFinishedPulling="2026-05-28 17:20:59.622715709 +0000 UTC m=+191.003840683" observedRunningTime="2026-05-28 17:21:00.001822979 +0000 UTC m=+191.382947984" watchObservedRunningTime="2026-05-28 17:21:00.003198941 +0000 UTC m=+191.384323924"
May 28 17:21:10.202428 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:10.202388    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:10.217900 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:10.217876    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:11.032553 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:11.032529    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:35.456488 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.456447    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n57qq"]
May 28 17:21:35.458845 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.458822    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.461362 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.461333    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 17:21:35.461479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.461369    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lxbdk\""
May 28 17:21:35.461479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.461335    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 17:21:35.465550 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.465520    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n57qq"]
May 28 17:21:35.621035 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.621000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.621035 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.621036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwv8\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-kube-api-access-5gwv8\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.721961 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.721845    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.721961 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.721890    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwv8\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-kube-api-access-5gwv8\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.731178 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.731144    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.731304 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.731232    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwv8\" (UniqueName: \"kubernetes.io/projected/4cb8fd87-d150-4356-adf4-85f79e80836a-kube-api-access-5gwv8\") pod \"cert-manager-webhook-587ccfb98-n57qq\" (UID: \"4cb8fd87-d150-4356-adf4-85f79e80836a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.783059 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.783027    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:35.909791 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:35.909758    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n57qq"]
May 28 17:21:35.913571 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:21:35.913537    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cb8fd87_d150_4356_adf4_85f79e80836a.slice/crio-4524595479de70ae8471f1d87ac1e016c1a1fa717793a99322e8a5b91b0957ff WatchSource:0}: Error finding container 4524595479de70ae8471f1d87ac1e016c1a1fa717793a99322e8a5b91b0957ff: Status 404 returned error can't find the container with id 4524595479de70ae8471f1d87ac1e016c1a1fa717793a99322e8a5b91b0957ff
May 28 17:21:36.089531 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:36.089496    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq" event={"ID":"4cb8fd87-d150-4356-adf4-85f79e80836a","Type":"ContainerStarted","Data":"4524595479de70ae8471f1d87ac1e016c1a1fa717793a99322e8a5b91b0957ff"}
May 28 17:21:39.025043 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.025002    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4gd88"]
May 28 17:21:39.028910 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.028882    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.031646 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.031619    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gbc2t\""
May 28 17:21:39.036229 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.036204    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4gd88"]
May 28 17:21:39.055328 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.055297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.055527 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.055384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99976\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-kube-api-access-99976\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.156830 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.156794    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.157000 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.156847    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99976\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-kube-api-access-99976\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.164311 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.164279    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.164436 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.164360    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99976\" (UniqueName: \"kubernetes.io/projected/5c650ebe-1217-475a-ba19-b181066ad20a-kube-api-access-99976\") pod \"cert-manager-cainjector-68b757865b-4gd88\" (UID: \"5c650ebe-1217-475a-ba19-b181066ad20a\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.340983 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.340956    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88"
May 28 17:21:39.470563 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:39.470535    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4gd88"]
May 28 17:21:39.473459 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:21:39.473434    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c650ebe_1217_475a_ba19_b181066ad20a.slice/crio-f74861ec7edcbe6d7a4bd04ceb2d22defa52c3536afc9a45708df83fce4e9904 WatchSource:0}: Error finding container f74861ec7edcbe6d7a4bd04ceb2d22defa52c3536afc9a45708df83fce4e9904: Status 404 returned error can't find the container with id f74861ec7edcbe6d7a4bd04ceb2d22defa52c3536afc9a45708df83fce4e9904
May 28 17:21:40.103230 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.103188    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq" event={"ID":"4cb8fd87-d150-4356-adf4-85f79e80836a","Type":"ContainerStarted","Data":"ef5aa8d986e81739712e2525b9bfccc992aafecd12863f33fa022c70b41a6f26"}
May 28 17:21:40.103681 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.103317    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:21:40.104530 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.104506    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88" event={"ID":"5c650ebe-1217-475a-ba19-b181066ad20a","Type":"ContainerStarted","Data":"4a169f1d10ff3a1a97908290f8d3c368232ca9647b41c3d42000b6c370d51b7e"}
May 28 17:21:40.104621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.104535    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88" event={"ID":"5c650ebe-1217-475a-ba19-b181066ad20a","Type":"ContainerStarted","Data":"f74861ec7edcbe6d7a4bd04ceb2d22defa52c3536afc9a45708df83fce4e9904"}
May 28 17:21:40.119772 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.119728    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq" podStartSLOduration=1.814771479 podStartE2EDuration="5.119717484s" podCreationTimestamp="2026-05-28 17:21:35 +0000 UTC" firstStartedPulling="2026-05-28 17:21:35.915264934 +0000 UTC m=+227.296389895" lastFinishedPulling="2026-05-28 17:21:39.220210937 +0000 UTC m=+230.601335900" observedRunningTime="2026-05-28 17:21:40.117956634 +0000 UTC m=+231.499081612" watchObservedRunningTime="2026-05-28 17:21:40.119717484 +0000 UTC m=+231.500842465"
May 28 17:21:40.132299 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:40.132266    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-4gd88" podStartSLOduration=1.132257268 podStartE2EDuration="1.132257268s" podCreationTimestamp="2026-05-28 17:21:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:21:40.131424621 +0000 UTC m=+231.512549604" watchObservedRunningTime="2026-05-28 17:21:40.132257268 +0000 UTC m=+231.513382250"
May 28 17:21:46.110247 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:21:46.110215    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-n57qq"
May 28 17:22:12.301126 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.301045    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"]
May 28 17:22:12.303354 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.303337    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.305855 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.305835    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 17:22:12.305855 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.305851    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tbcs9\""
May 28 17:22:12.306115 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.306098    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 17:22:12.306193 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.306116    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 17:22:12.306358 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.306343    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 17:22:12.316510 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.316487    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"]
May 28 17:22:12.443771 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.443712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d7j\" (UniqueName: \"kubernetes.io/projected/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-kube-api-access-w8d7j\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.443991 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.443871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.443991 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.443912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.544779 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.544742    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.544779 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.544784    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.545031 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.544958    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d7j\" (UniqueName: \"kubernetes.io/projected/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-kube-api-access-w8d7j\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.547286 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.547257    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.547397 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.547309    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.553182 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.553161    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d7j\" (UniqueName: \"kubernetes.io/projected/f0961beb-0daa-4acc-bf2d-1a7c924ce7c7-kube-api-access-w8d7j\") pod \"opendatahub-operator-controller-manager-7bc6886474-mddkq\" (UID: \"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7\") " pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.613409 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.613378    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:12.745054 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:12.745005    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"]
May 28 17:22:12.747500 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:22:12.747469    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0961beb_0daa_4acc_bf2d_1a7c924ce7c7.slice/crio-1979af8c64f9d37f4db8d8696742399dfa3ac10c4baabe483cf5d2da2d6d723d WatchSource:0}: Error finding container 1979af8c64f9d37f4db8d8696742399dfa3ac10c4baabe483cf5d2da2d6d723d: Status 404 returned error can't find the container with id 1979af8c64f9d37f4db8d8696742399dfa3ac10c4baabe483cf5d2da2d6d723d
May 28 17:22:13.212405 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:13.212370    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq" event={"ID":"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7","Type":"ContainerStarted","Data":"1979af8c64f9d37f4db8d8696742399dfa3ac10c4baabe483cf5d2da2d6d723d"}
May 28 17:22:15.556742 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.556710    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"]
May 28 17:22:15.560148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.560131    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.562766 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.562745    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 17:22:15.562890 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.562839    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 17:22:15.564002 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.563979    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 17:22:15.564105 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.564026    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 17:22:15.564105 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.564064    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 17:22:15.564224 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.564210    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d872v\""
May 28 17:22:15.570534 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.570514    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"]
May 28 17:22:15.674215 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.674182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc58l\" (UniqueName: \"kubernetes.io/projected/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-kube-api-access-cc58l\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.674390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.674219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.674390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.674318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-metrics-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.674390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.674353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-manager-config\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.775621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.775572    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc58l\" (UniqueName: \"kubernetes.io/projected/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-kube-api-access-cc58l\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.775621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.775627    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.775872 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.775709    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-metrics-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.775872 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.775746    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-manager-config\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.776379 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.776348    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-manager-config\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.778297 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.778277    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-metrics-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.778389 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.778324    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-cert\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.785454 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.785435    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc58l\" (UniqueName: \"kubernetes.io/projected/63f25ad6-12ca-4cbc-8c37-af2c4f8c13da-kube-api-access-cc58l\") pod \"lws-controller-manager-5787d77675-dtpr8\" (UID: \"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da\") " pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:15.869990 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:15.869885    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:16.016076 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:16.016047    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"]
May 28 17:22:16.019607 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:22:16.019581    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f25ad6_12ca_4cbc_8c37_af2c4f8c13da.slice/crio-54d9ac2db653cc4aae4c639c37724207e7d2feef06bfb11262bfe6b0d2396e81 WatchSource:0}: Error finding container 54d9ac2db653cc4aae4c639c37724207e7d2feef06bfb11262bfe6b0d2396e81: Status 404 returned error can't find the container with id 54d9ac2db653cc4aae4c639c37724207e7d2feef06bfb11262bfe6b0d2396e81
May 28 17:22:16.223390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:16.223297    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq" event={"ID":"f0961beb-0daa-4acc-bf2d-1a7c924ce7c7","Type":"ContainerStarted","Data":"f7a2e0d2758da3fb4fddf97eedd32e0dd441e73aeb325402dae44814678d299f"}
May 28 17:22:16.223390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:16.223345    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:16.224392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:16.224368    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8" event={"ID":"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da","Type":"ContainerStarted","Data":"54d9ac2db653cc4aae4c639c37724207e7d2feef06bfb11262bfe6b0d2396e81"}
May 28 17:22:16.262356 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:16.262306    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq" podStartSLOduration=1.7524529389999999 podStartE2EDuration="4.262293184s" podCreationTimestamp="2026-05-28 17:22:12 +0000 UTC" firstStartedPulling="2026-05-28 17:22:12.749213458 +0000 UTC m=+264.130338438" lastFinishedPulling="2026-05-28 17:22:15.259053706 +0000 UTC m=+266.640178683" observedRunningTime="2026-05-28 17:22:16.260459133 +0000 UTC m=+267.641584131" watchObservedRunningTime="2026-05-28 17:22:16.262293184 +0000 UTC m=+267.643418166"
May 28 17:22:19.236384 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:19.236354    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8" event={"ID":"63f25ad6-12ca-4cbc-8c37-af2c4f8c13da","Type":"ContainerStarted","Data":"9d286bcf90c1c79559e797ad3014207fc96f725f8f3aae3f7271a403512596ad"}
May 28 17:22:19.236694 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:19.236468    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:19.268298 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:19.268252    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8" podStartSLOduration=1.127893164 podStartE2EDuration="4.26823701s" podCreationTimestamp="2026-05-28 17:22:15 +0000 UTC" firstStartedPulling="2026-05-28 17:22:16.021278994 +0000 UTC m=+267.402403955" lastFinishedPulling="2026-05-28 17:22:19.161622834 +0000 UTC m=+270.542747801" observedRunningTime="2026-05-28 17:22:19.268026948 +0000 UTC m=+270.649151932" watchObservedRunningTime="2026-05-28 17:22:19.26823701 +0000 UTC m=+270.649361991"
May 28 17:22:27.238903 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:27.238875    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bc6886474-mddkq"
May 28 17:22:30.241981 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.241947    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5787d77675-dtpr8"
May 28 17:22:30.779477 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.779442    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"]
May 28 17:22:30.783098 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.783076    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.786845 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.786816    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 17:22:30.786845 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.786830    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ldwnr\""
May 28 17:22:30.787044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.786850    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 17:22:30.787044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.786834    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 17:22:30.787044 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.786816    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 17:22:30.791169 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.791146    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"]
May 28 17:22:30.809971 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.809909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4224413-869e-4a84-9913-c335ebb229a5-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.810098 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.810044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4224413-869e-4a84-9913-c335ebb229a5-tmp\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.810147 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.810108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbws\" (UniqueName: \"kubernetes.io/projected/f4224413-869e-4a84-9913-c335ebb229a5-kube-api-access-qnbws\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.910805 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.910764    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbws\" (UniqueName: \"kubernetes.io/projected/f4224413-869e-4a84-9913-c335ebb229a5-kube-api-access-qnbws\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.910971 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.910826    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4224413-869e-4a84-9913-c335ebb229a5-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.910971 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.910870    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4224413-869e-4a84-9913-c335ebb229a5-tmp\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.913115 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.913087    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4224413-869e-4a84-9913-c335ebb229a5-tmp\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.913351 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.913329    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4224413-869e-4a84-9913-c335ebb229a5-tls-certs\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:30.918393 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:30.918364    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbws\" (UniqueName: \"kubernetes.io/projected/f4224413-869e-4a84-9913-c335ebb229a5-kube-api-access-qnbws\") pod \"kube-auth-proxy-6c878b64bb-czrdv\" (UID: \"f4224413-869e-4a84-9913-c335ebb229a5\") " pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:31.094970 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:31.094935    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"
May 28 17:22:31.220286 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:31.220263    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv"]
May 28 17:22:31.223235 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:22:31.223207    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4224413_869e_4a84_9913_c335ebb229a5.slice/crio-72d5a21b904dd74c0c51d1aa2e117c21839b1fcff8cb0b9559f730e0745ae9d8 WatchSource:0}: Error finding container 72d5a21b904dd74c0c51d1aa2e117c21839b1fcff8cb0b9559f730e0745ae9d8: Status 404 returned error can't find the container with id 72d5a21b904dd74c0c51d1aa2e117c21839b1fcff8cb0b9559f730e0745ae9d8
May 28 17:22:31.274181 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:31.274152    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv" event={"ID":"f4224413-869e-4a84-9913-c335ebb229a5","Type":"ContainerStarted","Data":"72d5a21b904dd74c0c51d1aa2e117c21839b1fcff8cb0b9559f730e0745ae9d8"}
May 28 17:22:34.293447 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:34.293412    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv" event={"ID":"f4224413-869e-4a84-9913-c335ebb229a5","Type":"ContainerStarted","Data":"822d3ed23df58ddea6be5c3ad6fc075680b3823334c070bb264bbd22c1ba9f13"}
May 28 17:22:34.312022 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:34.311910    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c878b64bb-czrdv" podStartSLOduration=1.407685119 podStartE2EDuration="4.311889799s" podCreationTimestamp="2026-05-28 17:22:30 +0000 UTC" firstStartedPulling="2026-05-28 17:22:31.225029029 +0000 UTC m=+282.606153989" lastFinishedPulling="2026-05-28 17:22:34.129233698 +0000 UTC m=+285.510358669" observedRunningTime="2026-05-28 17:22:34.310573813 +0000 UTC m=+285.691698806" watchObservedRunningTime="2026-05-28 17:22:34.311889799 +0000 UTC m=+285.693014784"
May 28 17:22:49.144558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:49.144526    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:22:49.145949 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:49.145909    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:22:49.149029 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:22:49.149010    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 28 17:24:12.111183 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.111148    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"]
May 28 17:24:12.113529 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.113513    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:12.116523 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.116503    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 17:24:12.116523 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.116508    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gss4c\""
May 28 17:24:12.117594 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.117578    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 17:24:12.129522 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.129501    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"]
May 28 17:24:12.249722 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.249687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnfnj\" (UniqueName: \"kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj\") pod \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" (UID: \"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:12.351073 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.351036    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnfnj\" (UniqueName: \"kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj\") pod \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" (UID: \"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:12.359673 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.359642    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnfnj\" (UniqueName: \"kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj\") pod \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" (UID: \"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:12.423884 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.423792    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:12.545751 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.545715    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"]
May 28 17:24:12.549477 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:24:12.549440    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fd7990_2f9b_4611_bcab_90b4c5e5e4d8.slice/crio-faf8cebb2d13b0f4bfa7593b8360faa46ac7d128c4bb466322ca27d2a2c44b77 WatchSource:0}: Error finding container faf8cebb2d13b0f4bfa7593b8360faa46ac7d128c4bb466322ca27d2a2c44b77: Status 404 returned error can't find the container with id faf8cebb2d13b0f4bfa7593b8360faa46ac7d128c4bb466322ca27d2a2c44b77
May 28 17:24:12.551266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.551252    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:24:12.621734 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:12.621703    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" event={"ID":"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8","Type":"ContainerStarted","Data":"faf8cebb2d13b0f4bfa7593b8360faa46ac7d128c4bb466322ca27d2a2c44b77"}
May 28 17:24:14.629746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:14.629709    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" event={"ID":"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8","Type":"ContainerStarted","Data":"27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7"}
May 28 17:24:14.630154 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:14.629850    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:14.646107 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:14.646060    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" podStartSLOduration=0.735593502 podStartE2EDuration="2.646047802s" podCreationTimestamp="2026-05-28 17:24:12 +0000 UTC" firstStartedPulling="2026-05-28 17:24:12.551376988 +0000 UTC m=+383.932501947" lastFinishedPulling="2026-05-28 17:24:14.461831272 +0000 UTC m=+385.842956247" observedRunningTime="2026-05-28 17:24:14.644012267 +0000 UTC m=+386.025137246" watchObservedRunningTime="2026-05-28 17:24:14.646047802 +0000 UTC m=+386.027172784"
May 28 17:24:25.377128 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.377089    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"]
May 28 17:24:25.377615 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.377403    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" containerName="manager" containerID="cri-o://27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7" gracePeriod=2
May 28 17:24:25.379158 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.379113    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:25.383693 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.383668    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"]
May 28 17:24:25.388447 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.388416    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:25.404040 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.404017    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"]
May 28 17:24:25.404368 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.404357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" containerName="manager"
May 28 17:24:25.404411 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.404370    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" containerName="manager"
May 28 17:24:25.404444 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.404436    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" containerName="manager"
May 28 17:24:25.406413 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.406388    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:25.419274 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.419231    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"]
May 28 17:24:25.443385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.443350    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:25.572761 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.572729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8cv5\" (UniqueName: \"kubernetes.io/projected/d222ca3c-3a77-482a-b8d9-23121b095111-kube-api-access-v8cv5\") pod \"limitador-operator-controller-manager-85c4996f8c-8jx85\" (UID: \"d222ca3c-3a77-482a-b8d9-23121b095111\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:25.609188 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.609165    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:25.611397 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.611368    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:25.671757 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.671645    2558 generic.go:358] "Generic (PLEG): container finished" podID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" containerID="27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7" exitCode=0
May 28 17:24:25.671906 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.671800    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6"
May 28 17:24:25.671906 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.671804    2558 scope.go:117] "RemoveContainer" containerID="27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7"
May 28 17:24:25.674355 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.674328    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8cv5\" (UniqueName: \"kubernetes.io/projected/d222ca3c-3a77-482a-b8d9-23121b095111-kube-api-access-v8cv5\") pod \"limitador-operator-controller-manager-85c4996f8c-8jx85\" (UID: \"d222ca3c-3a77-482a-b8d9-23121b095111\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:25.674467 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.674332    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:25.680029 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.680011    2558 scope.go:117] "RemoveContainer" containerID="27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7"
May 28 17:24:25.680294 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:24:25.680276    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7\": container with ID starting with 27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7 not found: ID does not exist" containerID="27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7"
May 28 17:24:25.680339 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.680302    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7"} err="failed to get container status \"27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7\": rpc error: code = NotFound desc = could not find container \"27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7\": container with ID starting with 27cdbf62b3985b06cb805f3bc3a96db68edbe14c191d3e39962297d76581bbf7 not found: ID does not exist"
May 28 17:24:25.685152 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.685131    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8cv5\" (UniqueName: \"kubernetes.io/projected/d222ca3c-3a77-482a-b8d9-23121b095111-kube-api-access-v8cv5\") pod \"limitador-operator-controller-manager-85c4996f8c-8jx85\" (UID: \"d222ca3c-3a77-482a-b8d9-23121b095111\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:25.756533 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.756499    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:25.775491 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.775463    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnfnj\" (UniqueName: \"kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj\") pod \"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8\" (UID: \"55fd7990-2f9b-4611-bcab-90b4c5e5e4d8\") "
May 28 17:24:25.777592 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.777569    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj" (OuterVolumeSpecName: "kube-api-access-hnfnj") pod "55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" (UID: "55fd7990-2f9b-4611-bcab-90b4c5e5e4d8"). InnerVolumeSpecName "kube-api-access-hnfnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:24:25.876527 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.876500    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnfnj\" (UniqueName: \"kubernetes.io/projected/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8-kube-api-access-hnfnj\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:24:25.883952 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.883931    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"]
May 28 17:24:25.886235 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:24:25.886206    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd222ca3c_3a77_482a_b8d9_23121b095111.slice/crio-21fb39741437f53d20542a3e1fe505dbb4e04c5f7e3606a7dd0706a26f25d5c5 WatchSource:0}: Error finding container 21fb39741437f53d20542a3e1fe505dbb4e04c5f7e3606a7dd0706a26f25d5c5: Status 404 returned error can't find the container with id 21fb39741437f53d20542a3e1fe505dbb4e04c5f7e3606a7dd0706a26f25d5c5
May 28 17:24:25.983773 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:25.983733    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:26.677731 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:26.677640    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85" event={"ID":"d222ca3c-3a77-482a-b8d9-23121b095111","Type":"ContainerStarted","Data":"f243633bf79a0ee59bf57bd416d7d58de4f34b8b47edc09f65cc2a51f30f220b"}
May 28 17:24:26.677731 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:26.677676    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85" event={"ID":"d222ca3c-3a77-482a-b8d9-23121b095111","Type":"ContainerStarted","Data":"21fb39741437f53d20542a3e1fe505dbb4e04c5f7e3606a7dd0706a26f25d5c5"}
May 28 17:24:26.677731 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:26.677700    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:24:26.709571 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:26.709522    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85" podStartSLOduration=1.7095074019999998 podStartE2EDuration="1.709507402s" podCreationTimestamp="2026-05-28 17:24:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:24:26.707162784 +0000 UTC m=+398.088287766" watchObservedRunningTime="2026-05-28 17:24:26.709507402 +0000 UTC m=+398.090632384"
May 28 17:24:26.709870 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:26.709843    2558 status_manager.go:895] "Failed to get status for pod" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lzgr6" err="pods \"limitador-operator-controller-manager-85c4996f8c-lzgr6\" is forbidden: User \"system:node:ip-10-0-128-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-101.ec2.internal' and this object"
May 28 17:24:27.233787 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:27.233749    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55fd7990-2f9b-4611-bcab-90b4c5e5e4d8" path="/var/lib/kubelet/pods/55fd7990-2f9b-4611-bcab-90b4c5e5e4d8/volumes"
May 28 17:24:37.683666 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:24:37.683634    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8jx85"
May 28 17:25:13.716052 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.715975    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:13.719511 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.719493    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:13.721782 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.721760    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-llln2\""
May 28 17:25:13.725581 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.725549    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:13.887797 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.887762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrzl\" (UniqueName: \"kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl\") pod \"authorino-7498df8756-j6qdv\" (UID: \"2ee424e8-882d-4e5a-a51e-01740f31956c\") " pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:13.989075 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.988988    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msrzl\" (UniqueName: \"kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl\") pod \"authorino-7498df8756-j6qdv\" (UID: \"2ee424e8-882d-4e5a-a51e-01740f31956c\") " pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:13.996541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:13.996512    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrzl\" (UniqueName: \"kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl\") pod \"authorino-7498df8756-j6qdv\" (UID: \"2ee424e8-882d-4e5a-a51e-01740f31956c\") " pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:14.029670 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:14.029636    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:14.153628 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:14.153602    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:14.156135 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:25:14.156108    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ee424e8_882d_4e5a_a51e_01740f31956c.slice/crio-5124952ee122637c96902081971d4f0b596a51a07ba13c31c501934d6d87edc0 WatchSource:0}: Error finding container 5124952ee122637c96902081971d4f0b596a51a07ba13c31c501934d6d87edc0: Status 404 returned error can't find the container with id 5124952ee122637c96902081971d4f0b596a51a07ba13c31c501934d6d87edc0
May 28 17:25:14.837428 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:14.837373    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j6qdv" event={"ID":"2ee424e8-882d-4e5a-a51e-01740f31956c","Type":"ContainerStarted","Data":"5124952ee122637c96902081971d4f0b596a51a07ba13c31c501934d6d87edc0"}
May 28 17:25:17.850751 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:17.850708    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j6qdv" event={"ID":"2ee424e8-882d-4e5a-a51e-01740f31956c","Type":"ContainerStarted","Data":"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"}
May 28 17:25:44.776551 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.776498    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-j6qdv" podStartSLOduration=28.852564091 podStartE2EDuration="31.776482601s" podCreationTimestamp="2026-05-28 17:25:13 +0000 UTC" firstStartedPulling="2026-05-28 17:25:14.15735387 +0000 UTC m=+445.538478832" lastFinishedPulling="2026-05-28 17:25:17.081272377 +0000 UTC m=+448.462397342" observedRunningTime="2026-05-28 17:25:17.864559331 +0000 UTC m=+449.245684309" watchObservedRunningTime="2026-05-28 17:25:44.776482601 +0000 UTC m=+476.157607639"
May 28 17:25:44.777536 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.777519    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:25:44.780887 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.780872    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.783310 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.783287    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 17:25:44.786261 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.786242    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:25:44.870360 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.870319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.870541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.870366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbk6\" (UniqueName: \"kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.971004 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.970966    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.971004 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.971010    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whbk6\" (UniqueName: \"kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.973436 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.973413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:44.978195 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:44.978175    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbk6\" (UniqueName: \"kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6\") pod \"authorino-787d59dd66-g5xkl\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") " pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:45.091201 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.091169    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:25:45.223645 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.223606    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:25:45.227316 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:25:45.227287    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod091f5d5f_2119_4f46_9e90_ac421bc0f142.slice/crio-634afef7d59e9d593e4f14a1800b451b247f4be41c38f1e0f6a9f9fdda32d531 WatchSource:0}: Error finding container 634afef7d59e9d593e4f14a1800b451b247f4be41c38f1e0f6a9f9fdda32d531: Status 404 returned error can't find the container with id 634afef7d59e9d593e4f14a1800b451b247f4be41c38f1e0f6a9f9fdda32d531
May 28 17:25:45.950308 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.950274    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d59dd66-g5xkl" event={"ID":"091f5d5f-2119-4f46-9e90-ac421bc0f142","Type":"ContainerStarted","Data":"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"}
May 28 17:25:45.950308 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.950311    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d59dd66-g5xkl" event={"ID":"091f5d5f-2119-4f46-9e90-ac421bc0f142","Type":"ContainerStarted","Data":"634afef7d59e9d593e4f14a1800b451b247f4be41c38f1e0f6a9f9fdda32d531"}
May 28 17:25:45.964933 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.964874    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-787d59dd66-g5xkl" podStartSLOduration=1.696210451 podStartE2EDuration="1.964860113s" podCreationTimestamp="2026-05-28 17:25:44 +0000 UTC" firstStartedPulling="2026-05-28 17:25:45.228529942 +0000 UTC m=+476.609654902" lastFinishedPulling="2026-05-28 17:25:45.497179605 +0000 UTC m=+476.878304564" observedRunningTime="2026-05-28 17:25:45.964341215 +0000 UTC m=+477.345466197" watchObservedRunningTime="2026-05-28 17:25:45.964860113 +0000 UTC m=+477.345985126"
May 28 17:25:45.994827 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.994798    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:45.995025 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:45.995004    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-j6qdv" podUID="2ee424e8-882d-4e5a-a51e-01740f31956c" containerName="authorino" containerID="cri-o://d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c" gracePeriod=30
May 28 17:25:46.230538 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.230516    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:46.280839 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.280800    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrzl\" (UniqueName: \"kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl\") pod \"2ee424e8-882d-4e5a-a51e-01740f31956c\" (UID: \"2ee424e8-882d-4e5a-a51e-01740f31956c\") "
May 28 17:25:46.282822 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.282785    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl" (OuterVolumeSpecName: "kube-api-access-msrzl") pod "2ee424e8-882d-4e5a-a51e-01740f31956c" (UID: "2ee424e8-882d-4e5a-a51e-01740f31956c"). InnerVolumeSpecName "kube-api-access-msrzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:25:46.381894 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.381865    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrzl\" (UniqueName: \"kubernetes.io/projected/2ee424e8-882d-4e5a-a51e-01740f31956c-kube-api-access-msrzl\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:25:46.954883 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.954845    2558 generic.go:358] "Generic (PLEG): container finished" podID="2ee424e8-882d-4e5a-a51e-01740f31956c" containerID="d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c" exitCode=0
May 28 17:25:46.955385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.954893    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-j6qdv"
May 28 17:25:46.955385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.954948    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j6qdv" event={"ID":"2ee424e8-882d-4e5a-a51e-01740f31956c","Type":"ContainerDied","Data":"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"}
May 28 17:25:46.955385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.954978    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-j6qdv" event={"ID":"2ee424e8-882d-4e5a-a51e-01740f31956c","Type":"ContainerDied","Data":"5124952ee122637c96902081971d4f0b596a51a07ba13c31c501934d6d87edc0"}
May 28 17:25:46.955385 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.954993    2558 scope.go:117] "RemoveContainer" containerID="d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"
May 28 17:25:46.963240 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.963225    2558 scope.go:117] "RemoveContainer" containerID="d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"
May 28 17:25:46.963474 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:25:46.963456    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c\": container with ID starting with d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c not found: ID does not exist" containerID="d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"
May 28 17:25:46.963520 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.963480    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c"} err="failed to get container status \"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c\": rpc error: code = NotFound desc = could not find container \"d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c\": container with ID starting with d3b96a9af46c923c984b9f9e72eeb933b773c3de83287fb9998d5aa632a1e03c not found: ID does not exist"
May 28 17:25:46.974288 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.974265    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:46.977610 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:46.977589    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-j6qdv"]
May 28 17:25:47.234881 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:25:47.234803    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee424e8-882d-4e5a-a51e-01740f31956c" path="/var/lib/kubelet/pods/2ee424e8-882d-4e5a-a51e-01740f31956c/volumes"
May 28 17:26:24.996228 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:24.996188    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"]
May 28 17:26:24.996689 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:24.996604    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee424e8-882d-4e5a-a51e-01740f31956c" containerName="authorino"
May 28 17:26:24.996689 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:24.996618    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee424e8-882d-4e5a-a51e-01740f31956c" containerName="authorino"
May 28 17:26:24.996761 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:24.996696    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ee424e8-882d-4e5a-a51e-01740f31956c" containerName="authorino"
May 28 17:26:24.999392 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:24.999376    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:25.001950 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.001914    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 17:26:25.009376 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.009356    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"]
May 28 17:26:25.092382 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.092347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhs6\" (UniqueName: \"kubernetes.io/projected/990f8750-bb05-4086-a1a8-f5c36bacec23-kube-api-access-6vhs6\") pod \"payload-processing-58b6c8fdc7-w2cdm\" (UID: \"990f8750-bb05-4086-a1a8-f5c36bacec23\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:25.193710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.193667    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhs6\" (UniqueName: \"kubernetes.io/projected/990f8750-bb05-4086-a1a8-f5c36bacec23-kube-api-access-6vhs6\") pod \"payload-processing-58b6c8fdc7-w2cdm\" (UID: \"990f8750-bb05-4086-a1a8-f5c36bacec23\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:25.201098 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.201071    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhs6\" (UniqueName: \"kubernetes.io/projected/990f8750-bb05-4086-a1a8-f5c36bacec23-kube-api-access-6vhs6\") pod \"payload-processing-58b6c8fdc7-w2cdm\" (UID: \"990f8750-bb05-4086-a1a8-f5c36bacec23\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:25.310784 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.310761    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:25.441267 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:25.441207    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"]
May 28 17:26:25.443670 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:26:25.443642    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990f8750_bb05_4086_a1a8_f5c36bacec23.slice/crio-2e4f327aaf5e2726f05f17917cdb7151e4b54572f2e5f3efae4e35186c184158 WatchSource:0}: Error finding container 2e4f327aaf5e2726f05f17917cdb7151e4b54572f2e5f3efae4e35186c184158: Status 404 returned error can't find the container with id 2e4f327aaf5e2726f05f17917cdb7151e4b54572f2e5f3efae4e35186c184158
May 28 17:26:26.092058 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:26.092011    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm" event={"ID":"990f8750-bb05-4086-a1a8-f5c36bacec23","Type":"ContainerStarted","Data":"2e4f327aaf5e2726f05f17917cdb7151e4b54572f2e5f3efae4e35186c184158"}
May 28 17:26:28.100885 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:28.100845    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm" event={"ID":"990f8750-bb05-4086-a1a8-f5c36bacec23","Type":"ContainerStarted","Data":"e51ea05aaee26c2d5ba573ecd272729963de6a9e852ff24a31d034571c19ea45"}
May 28 17:26:28.101376 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:28.100975    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:26:28.117322 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:28.117276    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm" podStartSLOduration=2.122579085 podStartE2EDuration="4.11726218s" podCreationTimestamp="2026-05-28 17:26:24 +0000 UTC" firstStartedPulling="2026-05-28 17:26:25.445320595 +0000 UTC m=+516.826445556" lastFinishedPulling="2026-05-28 17:26:27.440003691 +0000 UTC m=+518.821128651" observedRunningTime="2026-05-28 17:26:28.115825538 +0000 UTC m=+519.496950534" watchObservedRunningTime="2026-05-28 17:26:28.11726218 +0000 UTC m=+519.498387162"
May 28 17:26:39.107137 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:26:39.107060    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-w2cdm"
May 28 17:27:49.171641 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:27:49.171599    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:27:49.172244 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:27:49.172071    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:28:18.978902 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:18.978804    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c44946f75-l5hbc"]
May 28 17:28:18.982267 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:18.982252    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:18.986440 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:18.986414    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c44946f75-l5hbc"]
May 28 17:28:19.117334 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.117287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b814913-a631-48b5-9f65-3f276a094d86-tls-cert\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.117514 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.117345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tr2j\" (UniqueName: \"kubernetes.io/projected/1b814913-a631-48b5-9f65-3f276a094d86-kube-api-access-4tr2j\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.218451 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.218417    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b814913-a631-48b5-9f65-3f276a094d86-tls-cert\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.218647 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.218460    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tr2j\" (UniqueName: \"kubernetes.io/projected/1b814913-a631-48b5-9f65-3f276a094d86-kube-api-access-4tr2j\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.220865 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.220838    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b814913-a631-48b5-9f65-3f276a094d86-tls-cert\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.225254 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.225234    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tr2j\" (UniqueName: \"kubernetes.io/projected/1b814913-a631-48b5-9f65-3f276a094d86-kube-api-access-4tr2j\") pod \"authorino-5c44946f75-l5hbc\" (UID: \"1b814913-a631-48b5-9f65-3f276a094d86\") " pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.292945 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.292827    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c44946f75-l5hbc"
May 28 17:28:19.420432 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.420400    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c44946f75-l5hbc"]
May 28 17:28:19.422605 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:28:19.422581    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b814913_a631_48b5_9f65_3f276a094d86.slice/crio-e248b0a3cf431f1e3dcdccfe921bbef1bdca6d9a237f9b37aab002bb6b4bb287 WatchSource:0}: Error finding container e248b0a3cf431f1e3dcdccfe921bbef1bdca6d9a237f9b37aab002bb6b4bb287: Status 404 returned error can't find the container with id e248b0a3cf431f1e3dcdccfe921bbef1bdca6d9a237f9b37aab002bb6b4bb287
May 28 17:28:19.486075 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:19.486032    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c44946f75-l5hbc" event={"ID":"1b814913-a631-48b5-9f65-3f276a094d86","Type":"ContainerStarted","Data":"e248b0a3cf431f1e3dcdccfe921bbef1bdca6d9a237f9b37aab002bb6b4bb287"}
May 28 17:28:20.490527 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.490492    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c44946f75-l5hbc" event={"ID":"1b814913-a631-48b5-9f65-3f276a094d86","Type":"ContainerStarted","Data":"f761ce9f3787003b5675503697715d9ce12f8cba1df19891b0495a096fed59d6"}
May 28 17:28:20.504266 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.504215    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5c44946f75-l5hbc" podStartSLOduration=2.161294766 podStartE2EDuration="2.504201628s" podCreationTimestamp="2026-05-28 17:28:18 +0000 UTC" firstStartedPulling="2026-05-28 17:28:19.423808834 +0000 UTC m=+630.804933794" lastFinishedPulling="2026-05-28 17:28:19.766715683 +0000 UTC m=+631.147840656" observedRunningTime="2026-05-28 17:28:20.502954458 +0000 UTC m=+631.884079442" watchObservedRunningTime="2026-05-28 17:28:20.504201628 +0000 UTC m=+631.885326610"
May 28 17:28:20.521354 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.521323    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:28:20.521528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.521508    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-787d59dd66-g5xkl" podUID="091f5d5f-2119-4f46-9e90-ac421bc0f142" containerName="authorino" containerID="cri-o://14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e" gracePeriod=30
May 28 17:28:20.762691 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.762669    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:28:20.935979 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.935916    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert\") pod \"091f5d5f-2119-4f46-9e90-ac421bc0f142\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") "
May 28 17:28:20.936170 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.936107    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whbk6\" (UniqueName: \"kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6\") pod \"091f5d5f-2119-4f46-9e90-ac421bc0f142\" (UID: \"091f5d5f-2119-4f46-9e90-ac421bc0f142\") "
May 28 17:28:20.938072 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.938045    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6" (OuterVolumeSpecName: "kube-api-access-whbk6") pod "091f5d5f-2119-4f46-9e90-ac421bc0f142" (UID: "091f5d5f-2119-4f46-9e90-ac421bc0f142"). InnerVolumeSpecName "kube-api-access-whbk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:28:20.946178 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:20.946149    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "091f5d5f-2119-4f46-9e90-ac421bc0f142" (UID: "091f5d5f-2119-4f46-9e90-ac421bc0f142"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:28:21.036759 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.036685    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whbk6\" (UniqueName: \"kubernetes.io/projected/091f5d5f-2119-4f46-9e90-ac421bc0f142-kube-api-access-whbk6\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:28:21.036759 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.036712    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/091f5d5f-2119-4f46-9e90-ac421bc0f142-tls-cert\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:28:21.494706 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.494672    2558 generic.go:358] "Generic (PLEG): container finished" podID="091f5d5f-2119-4f46-9e90-ac421bc0f142" containerID="14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e" exitCode=0
May 28 17:28:21.495148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.494731    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787d59dd66-g5xkl"
May 28 17:28:21.495148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.494762    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d59dd66-g5xkl" event={"ID":"091f5d5f-2119-4f46-9e90-ac421bc0f142","Type":"ContainerDied","Data":"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"}
May 28 17:28:21.495148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.494804    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787d59dd66-g5xkl" event={"ID":"091f5d5f-2119-4f46-9e90-ac421bc0f142","Type":"ContainerDied","Data":"634afef7d59e9d593e4f14a1800b451b247f4be41c38f1e0f6a9f9fdda32d531"}
May 28 17:28:21.495148 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.494819    2558 scope.go:117] "RemoveContainer" containerID="14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"
May 28 17:28:21.503141 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.503115    2558 scope.go:117] "RemoveContainer" containerID="14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"
May 28 17:28:21.503390 ip-10-0-128-101 kubenswrapper[2558]: E0528 17:28:21.503373    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e\": container with ID starting with 14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e not found: ID does not exist" containerID="14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"
May 28 17:28:21.503439 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.503398    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e"} err="failed to get container status \"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e\": rpc error: code = NotFound desc = could not find container \"14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e\": container with ID starting with 14efbb8fbff28489279e4bc984c62f3657d2d915675a46a798537a6f092f874e not found: ID does not exist"
May 28 17:28:21.509523 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.509502    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:28:21.512276 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:21.512257    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-787d59dd66-g5xkl"]
May 28 17:28:23.234388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:28:23.234355    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="091f5d5f-2119-4f46-9e90-ac421bc0f142" path="/var/lib/kubelet/pods/091f5d5f-2119-4f46-9e90-ac421bc0f142/volumes"
May 28 17:29:47.583503 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.583465    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-586998ffc7-jlxjs"]
May 28 17:29:47.583975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.583834    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="091f5d5f-2119-4f46-9e90-ac421bc0f142" containerName="authorino"
May 28 17:29:47.583975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.583845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="091f5d5f-2119-4f46-9e90-ac421bc0f142" containerName="authorino"
May 28 17:29:47.583975 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.583911    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="091f5d5f-2119-4f46-9e90-ac421bc0f142" containerName="authorino"
May 28 17:29:47.587016 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.587000    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:47.589494 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.589474    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 17:29:47.589621 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.589496    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gbscr\""
May 28 17:29:47.592891 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.592868    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586998ffc7-jlxjs"]
May 28 17:29:47.686643 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.686613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjrm\" (UniqueName: \"kubernetes.io/projected/ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e-kube-api-access-hxjrm\") pod \"maas-controller-586998ffc7-jlxjs\" (UID: \"ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e\") " pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:47.787674 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.787640    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjrm\" (UniqueName: \"kubernetes.io/projected/ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e-kube-api-access-hxjrm\") pod \"maas-controller-586998ffc7-jlxjs\" (UID: \"ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e\") " pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:47.798017 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.797989    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjrm\" (UniqueName: \"kubernetes.io/projected/ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e-kube-api-access-hxjrm\") pod \"maas-controller-586998ffc7-jlxjs\" (UID: \"ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e\") " pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:47.898282 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:47.898195    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:48.025997 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:48.025969    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586998ffc7-jlxjs"]
May 28 17:29:48.028091 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:29:48.028063    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5a2dfd_2bd2_4ca1_b4ac_0e14ad4f8a4e.slice/crio-c3a1c5555af553340e18f49dd9d40c3fabf0e17f2b35281c011f3dd11078ae50 WatchSource:0}: Error finding container c3a1c5555af553340e18f49dd9d40c3fabf0e17f2b35281c011f3dd11078ae50: Status 404 returned error can't find the container with id c3a1c5555af553340e18f49dd9d40c3fabf0e17f2b35281c011f3dd11078ae50
May 28 17:29:48.029331 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:48.029315    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:29:48.794409 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:48.794337    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586998ffc7-jlxjs" event={"ID":"ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e","Type":"ContainerStarted","Data":"c3a1c5555af553340e18f49dd9d40c3fabf0e17f2b35281c011f3dd11078ae50"}
May 28 17:29:50.469565 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:50.469542    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 17:29:50.802294 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:50.802261    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586998ffc7-jlxjs" event={"ID":"ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e","Type":"ContainerStarted","Data":"700fa74bcc2a1b8c7e06b2e442706fc51ccc5f27eeea09fd369e98e50a9e5311"}
May 28 17:29:50.802455 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:50.802334    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:29:50.818388 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:29:50.818343    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-586998ffc7-jlxjs" podStartSLOduration=1.380936654 podStartE2EDuration="3.818329207s" podCreationTimestamp="2026-05-28 17:29:47 +0000 UTC" firstStartedPulling="2026-05-28 17:29:48.029438997 +0000 UTC m=+719.410563958" lastFinishedPulling="2026-05-28 17:29:50.466831548 +0000 UTC m=+721.847956511" observedRunningTime="2026-05-28 17:29:50.816431498 +0000 UTC m=+722.197556504" watchObservedRunningTime="2026-05-28 17:29:50.818329207 +0000 UTC m=+722.199454239"
May 28 17:30:00.136709 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.136669    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-4ktvp"]
May 28 17:30:00.140261 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.140244    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:00.142932 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.142900    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrmxb\""
May 28 17:30:00.144759 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.144725    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-4ktvp"]
May 28 17:30:00.296976 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.296900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shzw\" (UniqueName: \"kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw\") pod \"maas-api-key-cleanup-29666490-4ktvp\" (UID: \"4041a3ac-975c-45ba-9dce-c5526c2cd9ab\") " pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:00.398302 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.398214    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9shzw\" (UniqueName: \"kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw\") pod \"maas-api-key-cleanup-29666490-4ktvp\" (UID: \"4041a3ac-975c-45ba-9dce-c5526c2cd9ab\") " pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:00.406375 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.406342    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shzw\" (UniqueName: \"kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw\") pod \"maas-api-key-cleanup-29666490-4ktvp\" (UID: \"4041a3ac-975c-45ba-9dce-c5526c2cd9ab\") " pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:00.453093 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.453054    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:00.579514 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.579480    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666490-4ktvp"]
May 28 17:30:00.582505 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:30:00.582478    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4041a3ac_975c_45ba_9dce_c5526c2cd9ab.slice/crio-3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7 WatchSource:0}: Error finding container 3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7: Status 404 returned error can't find the container with id 3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7
May 28 17:30:00.836971 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:00.836938    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp" event={"ID":"4041a3ac-975c-45ba-9dce-c5526c2cd9ab","Type":"ContainerStarted","Data":"3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7"}
May 28 17:30:01.810330 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:01.810297    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-586998ffc7-jlxjs"
May 28 17:30:29.935845 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:29.935747    2558 generic.go:358] "Generic (PLEG): container finished" podID="4041a3ac-975c-45ba-9dce-c5526c2cd9ab" containerID="47112dcbbb187fc8ad6f6f9c0fbe5d58f6fc0b89e3c6d9b960451acc08d36a67" exitCode=0
May 28 17:30:29.935845 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:29.935830    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp" event={"ID":"4041a3ac-975c-45ba-9dce-c5526c2cd9ab","Type":"ContainerDied","Data":"47112dcbbb187fc8ad6f6f9c0fbe5d58f6fc0b89e3c6d9b960451acc08d36a67"}
May 28 17:30:31.073557 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.073527    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:30:31.178055 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.178022    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9shzw\" (UniqueName: \"kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw\") pod \"4041a3ac-975c-45ba-9dce-c5526c2cd9ab\" (UID: \"4041a3ac-975c-45ba-9dce-c5526c2cd9ab\") "
May 28 17:30:31.180146 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.180120    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw" (OuterVolumeSpecName: "kube-api-access-9shzw") pod "4041a3ac-975c-45ba-9dce-c5526c2cd9ab" (UID: "4041a3ac-975c-45ba-9dce-c5526c2cd9ab"). InnerVolumeSpecName "kube-api-access-9shzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:30:31.279512 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.279482    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9shzw\" (UniqueName: \"kubernetes.io/projected/4041a3ac-975c-45ba-9dce-c5526c2cd9ab-kube-api-access-9shzw\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:30:31.944547 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.944511    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp" event={"ID":"4041a3ac-975c-45ba-9dce-c5526c2cd9ab","Type":"ContainerDied","Data":"3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7"}
May 28 17:30:31.944547 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.944546    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3acc03f270773b9c537431ef1d53180dc1df6bf11fda07b1599006f699472dd7"
May 28 17:30:31.944547 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:30:31.944549    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666490-4ktvp"
May 28 17:32:49.199019 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:32:49.198991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:32:49.200420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:32:49.200401    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:37:49.224630 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:37:49.224604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:37:49.227200 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:37:49.226636    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:42:49.253541 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:42:49.253439    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:42:49.257655 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:42:49.256036    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:45:00.135097 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.135065    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-jdqx2"]
May 28 17:45:00.135583 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.135453    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4041a3ac-975c-45ba-9dce-c5526c2cd9ab" containerName="cleanup"
May 28 17:45:00.135583 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.135464    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4041a3ac-975c-45ba-9dce-c5526c2cd9ab" containerName="cleanup"
May 28 17:45:00.135583 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.135519    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="4041a3ac-975c-45ba-9dce-c5526c2cd9ab" containerName="cleanup"
May 28 17:45:00.138700 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.138683    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:00.141264 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.141245    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrmxb\""
May 28 17:45:00.148130 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.148108    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-jdqx2"]
May 28 17:45:00.206682 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.206649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4ps\" (UniqueName: \"kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps\") pod \"maas-api-key-cleanup-29666505-jdqx2\" (UID: \"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2\") " pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:00.307561 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.307526    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4ps\" (UniqueName: \"kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps\") pod \"maas-api-key-cleanup-29666505-jdqx2\" (UID: \"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2\") " pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:00.315174 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.315149    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4ps\" (UniqueName: \"kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps\") pod \"maas-api-key-cleanup-29666505-jdqx2\" (UID: \"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2\") " pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:00.450037 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.449959    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:00.577886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.577860    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666505-jdqx2"]
May 28 17:45:00.580504 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:45:00.580476    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e94d178_18e0_4e96_9090_d2c1e5b4d9e2.slice/crio-a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa WatchSource:0}: Error finding container a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa: Status 404 returned error can't find the container with id a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa
May 28 17:45:00.582189 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.582169    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:45:00.975677 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.975632    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2" event={"ID":"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2","Type":"ContainerStarted","Data":"08efa9a7cfaea499a67af3b9be9e5fff571ef654b3fcebfc7fccff60f7c32e64"}
May 28 17:45:00.975677 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.975678    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2" event={"ID":"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2","Type":"ContainerStarted","Data":"a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa"}
May 28 17:45:00.990441 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:00.990395    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2" podStartSLOduration=0.990381619 podStartE2EDuration="990.381619ms" podCreationTimestamp="2026-05-28 17:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:45:00.988995205 +0000 UTC m=+1632.370120187" watchObservedRunningTime="2026-05-28 17:45:00.990381619 +0000 UTC m=+1632.371506600"
May 28 17:45:01.980500 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:01.980418    2558 generic.go:358] "Generic (PLEG): container finished" podID="9e94d178-18e0-4e96-9090-d2c1e5b4d9e2" containerID="08efa9a7cfaea499a67af3b9be9e5fff571ef654b3fcebfc7fccff60f7c32e64" exitCode=0
May 28 17:45:01.980869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:01.980490    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2" event={"ID":"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2","Type":"ContainerDied","Data":"08efa9a7cfaea499a67af3b9be9e5fff571ef654b3fcebfc7fccff60f7c32e64"}
May 28 17:45:03.109825 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.109801    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:45:03.234017 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.233909    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl4ps\" (UniqueName: \"kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps\") pod \"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2\" (UID: \"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2\") "
May 28 17:45:03.235869 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.235843    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps" (OuterVolumeSpecName: "kube-api-access-nl4ps") pod "9e94d178-18e0-4e96-9090-d2c1e5b4d9e2" (UID: "9e94d178-18e0-4e96-9090-d2c1e5b4d9e2"). InnerVolumeSpecName "kube-api-access-nl4ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:45:03.335608 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.335573    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl4ps\" (UniqueName: \"kubernetes.io/projected/9e94d178-18e0-4e96-9090-d2c1e5b4d9e2-kube-api-access-nl4ps\") on node \"ip-10-0-128-101.ec2.internal\" DevicePath \"\""
May 28 17:45:03.987758 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.987720    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2" event={"ID":"9e94d178-18e0-4e96-9090-d2c1e5b4d9e2","Type":"ContainerDied","Data":"a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa"}
May 28 17:45:03.987758 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.987756    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a390b6ca585b605bb667eb6586d4d0b569fa5c3ca6dec4a8e9f70c90b98223fa"
May 28 17:45:03.988074 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:45:03.987782    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666505-jdqx2"
May 28 17:47:49.279231 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:47:49.279112    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:47:49.286134 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:47:49.283532    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:50:57.045889 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:50:57.045848    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c44946f75-l5hbc_1b814913-a631-48b5-9f65-3f276a094d86/authorino/0.log"
May 28 17:51:01.668997 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:01.668966    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-4ktvp_4041a3ac-975c-45ba-9dce-c5526c2cd9ab/cleanup/0.log"
May 28 17:51:01.775079 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:01.775048    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-jdqx2_9e94d178-18e0-4e96-9090-d2c1e5b4d9e2/cleanup/0.log"
May 28 17:51:01.893578 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:01.893543    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-586998ffc7-jlxjs_ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e/manager/0.log"
May 28 17:51:02.235479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:02.235443    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bc6886474-mddkq_f0961beb-0daa-4acc-bf2d-1a7c924ce7c7/manager/0.log"
May 28 17:51:03.779808 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:03.779776    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c44946f75-l5hbc_1b814913-a631-48b5-9f65-3f276a094d86/authorino/0.log"
May 28 17:51:04.593289 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:04.593248    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-8jx85_d222ca3c-3a77-482a-b8d9-23121b095111/manager/0.log"
May 28 17:51:05.150578 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:05.150539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c878b64bb-czrdv_f4224413-869e-4a84-9913-c335ebb229a5/kube-auth-proxy/0.log"
May 28 17:51:05.503963 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:05.503870    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-w2cdm_990f8750-bb05-4086-a1a8-f5c36bacec23/payload-processing/0.log"
May 28 17:51:10.648364 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.648330    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjd62/must-gather-7srnt"]
May 28 17:51:10.648730 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.648713    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e94d178-18e0-4e96-9090-d2c1e5b4d9e2" containerName="cleanup"
May 28 17:51:10.648730 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.648724    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e94d178-18e0-4e96-9090-d2c1e5b4d9e2" containerName="cleanup"
May 28 17:51:10.648809 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.648799    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e94d178-18e0-4e96-9090-d2c1e5b4d9e2" containerName="cleanup"
May 28 17:51:10.651506 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.651489    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.654239 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.654208    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjd62\"/\"kube-root-ca.crt\""
May 28 17:51:10.654239 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.654226    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjd62\"/\"openshift-service-ca.crt\""
May 28 17:51:10.654726 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.654710    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjd62\"/\"default-dockercfg-q975s\""
May 28 17:51:10.665589 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.665566    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/must-gather-7srnt"]
May 28 17:51:10.746961 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.746892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvrh\" (UniqueName: \"kubernetes.io/projected/ad5264bb-183a-4cc0-8922-00b896e75146-kube-api-access-6tvrh\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.747131 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.746971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad5264bb-183a-4cc0-8922-00b896e75146-must-gather-output\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.848439 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.848403    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvrh\" (UniqueName: \"kubernetes.io/projected/ad5264bb-183a-4cc0-8922-00b896e75146-kube-api-access-6tvrh\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.848574 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.848464    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad5264bb-183a-4cc0-8922-00b896e75146-must-gather-output\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.848762 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.848742    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad5264bb-183a-4cc0-8922-00b896e75146-must-gather-output\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.856246 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.856220    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvrh\" (UniqueName: \"kubernetes.io/projected/ad5264bb-183a-4cc0-8922-00b896e75146-kube-api-access-6tvrh\") pod \"must-gather-7srnt\" (UID: \"ad5264bb-183a-4cc0-8922-00b896e75146\") " pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:10.960570 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:10.960467    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/must-gather-7srnt"
May 28 17:51:11.096558 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:11.096505    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/must-gather-7srnt"]
May 28 17:51:11.099287 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:51:11.099257    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad5264bb_183a_4cc0_8922_00b896e75146.slice/crio-e71c9fd48d96b63833b9056feb4e6f1b18ef481befcf56807f5e1e63ada1958b WatchSource:0}: Error finding container e71c9fd48d96b63833b9056feb4e6f1b18ef481befcf56807f5e1e63ada1958b: Status 404 returned error can't find the container with id e71c9fd48d96b63833b9056feb4e6f1b18ef481befcf56807f5e1e63ada1958b
May 28 17:51:11.100973 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:11.100958    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:51:11.310443 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:11.310403    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/must-gather-7srnt" event={"ID":"ad5264bb-183a-4cc0-8922-00b896e75146","Type":"ContainerStarted","Data":"e71c9fd48d96b63833b9056feb4e6f1b18ef481befcf56807f5e1e63ada1958b"}
May 28 17:51:12.317552 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:12.317515    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/must-gather-7srnt" event={"ID":"ad5264bb-183a-4cc0-8922-00b896e75146","Type":"ContainerStarted","Data":"b4338c8843a5a533437b7720ea60f6eac1383995c755a6c0bcb92ab5165df8ef"}
May 28 17:51:12.317552 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:12.317554    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/must-gather-7srnt" event={"ID":"ad5264bb-183a-4cc0-8922-00b896e75146","Type":"ContainerStarted","Data":"877a7ba5f94e26abb805715e54166901e27c66af4931397d8598ed4d7793dbaa"}
May 28 17:51:12.332153 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:12.332090    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjd62/must-gather-7srnt" podStartSLOduration=1.616755549 podStartE2EDuration="2.332069675s" podCreationTimestamp="2026-05-28 17:51:10 +0000 UTC" firstStartedPulling="2026-05-28 17:51:11.101081076 +0000 UTC m=+2002.482206037" lastFinishedPulling="2026-05-28 17:51:11.8163952 +0000 UTC m=+2003.197520163" observedRunningTime="2026-05-28 17:51:12.330709758 +0000 UTC m=+2003.711834741" watchObservedRunningTime="2026-05-28 17:51:12.332069675 +0000 UTC m=+2003.713194658"
May 28 17:51:13.287168 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:13.287140    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtkqn_9291586b-6f53-4db8-8f2a-f6ec83727782/global-pull-secret-syncer/0.log"
May 28 17:51:13.374826 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:13.374788    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5zd64_fac2a693-8316-404c-8444-027f38e16005/konnectivity-agent/0.log"
May 28 17:51:13.447667 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:13.447635    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-101.ec2.internal_dc5e8b1d9115a5af2eceab20799575e1/haproxy/0.log"
May 28 17:51:17.621946 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:17.619678    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c44946f75-l5hbc_1b814913-a631-48b5-9f65-3f276a094d86/authorino/0.log"
May 28 17:51:17.928400 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:17.928312    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-8jx85_d222ca3c-3a77-482a-b8d9-23121b095111/manager/0.log"
May 28 17:51:19.212267 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.212231    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/alertmanager/0.log"
May 28 17:51:19.244420 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.244387    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/config-reloader/0.log"
May 28 17:51:19.286551 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.286453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/kube-rbac-proxy-web/0.log"
May 28 17:51:19.320340 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.320253    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/kube-rbac-proxy/0.log"
May 28 17:51:19.346828 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.346802    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/kube-rbac-proxy-metric/0.log"
May 28 17:51:19.373102 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.373077    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/prom-label-proxy/0.log"
May 28 17:51:19.401190 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.401158    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031363ed-83e1-4d47-b885-c38db41e7675/init-config-reloader/0.log"
May 28 17:51:19.463261 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.463198    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wj48c_8207f4fe-4045-4363-9f77-abc94b48520f/kube-state-metrics/0.log"
May 28 17:51:19.479855 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.479829    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wj48c_8207f4fe-4045-4363-9f77-abc94b48520f/kube-rbac-proxy-main/0.log"
May 28 17:51:19.500192 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.500138    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wj48c_8207f4fe-4045-4363-9f77-abc94b48520f/kube-rbac-proxy-self/0.log"
May 28 17:51:19.526131 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.526104    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7dc9555ff-75srm_614b9213-87eb-4823-9370-c32793b143ac/metrics-server/0.log"
May 28 17:51:19.559896 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.559863    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-gnk9j_2cd271b8-d79d-4892-abf1-c322b34137ab/monitoring-plugin/0.log"
May 28 17:51:19.730068 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.729976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcmtr_c3981277-d06e-4f2d-b134-ed4a720fcd50/node-exporter/0.log"
May 28 17:51:19.752080 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.752050    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcmtr_c3981277-d06e-4f2d-b134-ed4a720fcd50/kube-rbac-proxy/0.log"
May 28 17:51:19.774381 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.774349    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcmtr_c3981277-d06e-4f2d-b134-ed4a720fcd50/init-textfile/0.log"
May 28 17:51:19.795886 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.795855    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hxxkx_b7c87324-d4a2-46b5-8407-e0331ec51f8d/kube-rbac-proxy-main/0.log"
May 28 17:51:19.821505 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.821455    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hxxkx_b7c87324-d4a2-46b5-8407-e0331ec51f8d/kube-rbac-proxy-self/0.log"
May 28 17:51:19.842528 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.842494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hxxkx_b7c87324-d4a2-46b5-8407-e0331ec51f8d/openshift-state-metrics/0.log"
May 28 17:51:19.875477 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.875444    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/prometheus/0.log"
May 28 17:51:19.896246 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.896218    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/config-reloader/0.log"
May 28 17:51:19.918234 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.918164    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/thanos-sidecar/0.log"
May 28 17:51:19.938833 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.938803    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/kube-rbac-proxy-web/0.log"
May 28 17:51:19.958636 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.958606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/kube-rbac-proxy/0.log"
May 28 17:51:19.980151 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.980055    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/kube-rbac-proxy-thanos/0.log"
May 28 17:51:19.998110 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:19.998082    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abd135ff-82c8-42ed-831f-60aab2c3ffb7/init-config-reloader/0.log"
May 28 17:51:20.028074 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.028034    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zcwss_56e17a39-0340-4341-a001-847577cb1676/prometheus-operator/0.log"
May 28 17:51:20.047547 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.047522    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zcwss_56e17a39-0340-4341-a001-847577cb1676/kube-rbac-proxy/0.log"
May 28 17:51:20.101161 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.101128    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-575b559fbd-v86zz_55573284-4fd6-4fd8-97a5-d033b5660f2c/telemeter-client/0.log"
May 28 17:51:20.119399 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.119367    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-575b559fbd-v86zz_55573284-4fd6-4fd8-97a5-d033b5660f2c/reload/0.log"
May 28 17:51:20.139950 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.139892    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-575b559fbd-v86zz_55573284-4fd6-4fd8-97a5-d033b5660f2c/kube-rbac-proxy/0.log"
May 28 17:51:20.176199 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.176169    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/thanos-query/0.log"
May 28 17:51:20.196142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.196104    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/kube-rbac-proxy-web/0.log"
May 28 17:51:20.215423 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.215392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/kube-rbac-proxy/0.log"
May 28 17:51:20.234156 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.234081    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/prom-label-proxy/0.log"
May 28 17:51:20.256375 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.256338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/kube-rbac-proxy-rules/0.log"
May 28 17:51:20.277249 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:20.277225    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b64bfdf95-xbndv_d69455c1-9b8c-4c03-8605-22abcce72ba7/kube-rbac-proxy-metrics/0.log"
May 28 17:51:22.104769 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.104732    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"]
May 28 17:51:22.111984 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.111959    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.115686 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.114502    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"]
May 28 17:51:22.274479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.274443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-lib-modules\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.274479 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.274499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-sys\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.274748 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.274526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-proc\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.274748 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.274640    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsdv\" (UniqueName: \"kubernetes.io/projected/a770edda-547f-41fa-be3f-26482e89921a-kube-api-access-hdsdv\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.274748 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.274725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-podres\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.348174 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.348139    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-k47d8_21cf659d-5356-491b-96ad-1343ec8fb9b6/download-server/0.log"
May 28 17:51:22.375889 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.375803    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-podres\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.375889 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.375880    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-lib-modules\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.375956    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-sys\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.375986    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-proc\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.376049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsdv\" (UniqueName: \"kubernetes.io/projected/a770edda-547f-41fa-be3f-26482e89921a-kube-api-access-hdsdv\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.376116    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-proc\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376142 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.376121    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-sys\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376308 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.376202    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-lib-modules\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.376308 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.376227    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a770edda-547f-41fa-be3f-26482e89921a-podres\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.384332 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.384296    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsdv\" (UniqueName: \"kubernetes.io/projected/a770edda-547f-41fa-be3f-26482e89921a-kube-api-access-hdsdv\") pod \"perf-node-gather-daemonset-frz4f\" (UID: \"a770edda-547f-41fa-be3f-26482e89921a\") " pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.426383 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.426341    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:22.592964 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:22.592874    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"]
May 28 17:51:22.597210 ip-10-0-128-101 kubenswrapper[2558]: W0528 17:51:22.597177    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda770edda_547f_41fa_be3f_26482e89921a.slice/crio-1dd7e10d27f50bb08bc5cb4025c76b2b5b5dd2c5d6e968f71f352cfadb0b063d WatchSource:0}: Error finding container 1dd7e10d27f50bb08bc5cb4025c76b2b5b5dd2c5d6e968f71f352cfadb0b063d: Status 404 returned error can't find the container with id 1dd7e10d27f50bb08bc5cb4025c76b2b5b5dd2c5d6e968f71f352cfadb0b063d
May 28 17:51:23.371211 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.371171    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f" event={"ID":"a770edda-547f-41fa-be3f-26482e89921a","Type":"ContainerStarted","Data":"424f7a08c8be4a46f7cfc9cc1342f776b2acbb88deeda260266d52cc00c585e6"}
May 28 17:51:23.371681 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.371219    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f" event={"ID":"a770edda-547f-41fa-be3f-26482e89921a","Type":"ContainerStarted","Data":"1dd7e10d27f50bb08bc5cb4025c76b2b5b5dd2c5d6e968f71f352cfadb0b063d"}
May 28 17:51:23.372052 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.372024    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:23.388698 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.388638    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f" podStartSLOduration=1.388619399 podStartE2EDuration="1.388619399s" podCreationTimestamp="2026-05-28 17:51:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:51:23.385527199 +0000 UTC m=+2014.766652183" watchObservedRunningTime="2026-05-28 17:51:23.388619399 +0000 UTC m=+2014.769744383"
May 28 17:51:23.637493 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.637415    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvcq9_e90f2b94-0e57-469f-89e3-005af223d2e2/dns/0.log"
May 28 17:51:23.660712 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.660678    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvcq9_e90f2b94-0e57-469f-89e3-005af223d2e2/kube-rbac-proxy/0.log"
May 28 17:51:23.767396 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:23.767372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-skstw_281ee264-b051-48b1-af78-81bc24fe2597/dns-node-resolver/0.log"
May 28 17:51:24.227854 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:24.227825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22rln_d1dcd7e8-a536-42de-bb77-f24342f87b68/node-ca/0.log"
May 28 17:51:25.129768 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:25.129736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c878b64bb-czrdv_f4224413-869e-4a84-9913-c335ebb229a5/kube-auth-proxy/0.log"
May 28 17:51:25.299371 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:25.299343    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-w2cdm_990f8750-bb05-4086-a1a8-f5c36bacec23/payload-processing/0.log"
May 28 17:51:25.846710 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:25.846675    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkj8n_2016f273-c297-48df-8aa7-efaa72c67142/serve-healthcheck-canary/0.log"
May 28 17:51:26.437001 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:26.436965    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq6wn_f591e72e-bc68-4930-9405-481321417b2b/kube-rbac-proxy/0.log"
May 28 17:51:26.456201 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:26.456168    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq6wn_f591e72e-bc68-4930-9405-481321417b2b/exporter/0.log"
May 28 17:51:26.473718 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:26.473666    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq6wn_f591e72e-bc68-4930-9405-481321417b2b/extractor/0.log"
May 28 17:51:28.284596 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:28.284571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666490-4ktvp_4041a3ac-975c-45ba-9dce-c5526c2cd9ab/cleanup/0.log"
May 28 17:51:28.303729 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:28.303700    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666505-jdqx2_9e94d178-18e0-4e96-9090-d2c1e5b4d9e2/cleanup/0.log"
May 28 17:51:28.423014 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:28.422955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-586998ffc7-jlxjs_ad5a2dfd-2bd2-4ca1-b4ac-0e14ad4f8a4e/manager/0.log"
May 28 17:51:28.497987 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:28.497954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bc6886474-mddkq_f0961beb-0daa-4acc-bf2d-1a7c924ce7c7/manager/0.log"
May 28 17:51:29.606126 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:29.606077    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5787d77675-dtpr8_63f25ad6-12ca-4cbc-8c37-af2c4f8c13da/manager/0.log"
May 28 17:51:30.389207 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:30.389176    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjd62/perf-node-gather-daemonset-frz4f"
May 28 17:51:35.173731 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.173693    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4f7s6_a48c9423-4135-4901-89bb-ee4f0b05f796/kube-multus/0.log"
May 28 17:51:35.194697 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.194670    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/kube-multus-additional-cni-plugins/0.log"
May 28 17:51:35.212228 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.212206    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/egress-router-binary-copy/0.log"
May 28 17:51:35.229572 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.229541    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/cni-plugins/0.log"
May 28 17:51:35.248548 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.248528    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/bond-cni-plugin/0.log"
May 28 17:51:35.265338 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.265317    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/routeoverride-cni/0.log"
May 28 17:51:35.282299 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.282238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/whereabouts-cni-bincopy/0.log"
May 28 17:51:35.299390 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.299367    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xnv4_17762a6c-af3a-4d3b-9d25-b54aaee31d9d/whereabouts-cni/0.log"
May 28 17:51:35.680011 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.679975    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jntd7_40c24b68-d3f8-492f-a456-00027745fff5/network-metrics-daemon/0.log"
May 28 17:51:35.694655 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:35.694632    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jntd7_40c24b68-d3f8-492f-a456-00027745fff5/kube-rbac-proxy/0.log"
May 28 17:51:37.000409 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.000382    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-controller/0.log"
May 28 17:51:37.014261 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.014234    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/0.log"
May 28 17:51:37.033040 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.033002    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovn-acl-logging/1.log"
May 28 17:51:37.051274 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.051251    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/kube-rbac-proxy-node/0.log"
May 28 17:51:37.069325 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.069298    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/kube-rbac-proxy-ovn-metrics/0.log"
May 28 17:51:37.086438 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.086413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/northd/0.log"
May 28 17:51:37.103692 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.103660    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/nbdb/0.log"
May 28 17:51:37.120746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.120726    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/sbdb/0.log"
May 28 17:51:37.312093 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:37.312051    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s5mhs_7f55e9f6-0e2f-4ae9-81a0-5b7a036d256a/ovnkube-controller/0.log"
May 28 17:51:38.319574 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:38.319548    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xgsr5_64659e81-2211-4d05-8ed0-f60e4c601970/network-check-target-container/0.log"
May 28 17:51:39.238746 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:39.238696    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fk7zn_d19f277e-10b3-4194-a108-fe8c52722657/iptables-alerter/0.log"
May 28 17:51:39.933257 ip-10-0-128-101 kubenswrapper[2558]: I0528 17:51:39.933227    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cn4tz_a3a24b22-9b3f-44e0-844c-48359370e0fc/tuned/0.log"