May 27 01:59:23.076238 ip-10-0-128-250 systemd[1]: Starting Kubernetes Kubelet...
May 27 01:59:23.581753 ip-10-0-128-250 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:59:23.581753 ip-10-0-128-250 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 01:59:23.581753 ip-10-0-128-250 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:59:23.581753 ip-10-0-128-250 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 01:59:23.581753 ip-10-0-128-250 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 01:59:23.582564 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.581825    2547 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 01:59:23.587813 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587790    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:59:23.587813 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587808    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:59:23.587813 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587813    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:59:23.587813 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587817    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:59:23.587813 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587821    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587826    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587833    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587837    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587841    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587845    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587849    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587854    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587859    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587871    2547 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587876    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587880    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587884    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587888    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587892    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587896    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587900    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587904    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587908    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587912    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:59:23.588139 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587915    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587919    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587923    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587927    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587931    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587935    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587939    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587943    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587947    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587951    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587974    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587980    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587984    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587989    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587993    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.587999    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588003    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588008    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588012    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588016    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:59:23.588943 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588020    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588023    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588028    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588032    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588036    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588040    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588044    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588048    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588053    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588058    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588063    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588067    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588072    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588076    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588080    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588084    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588089    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588093    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588097    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588101    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:59:23.589643 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588105    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588110    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588125    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588130    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588134    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588137    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588143    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588147    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588152    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588156    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588160    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588165    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588169    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588174    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588178    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588182    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588186    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588191    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588195    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588201    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:59:23.590163 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588206    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588211    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588876    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588884    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588888    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588893    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588897    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588901    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588905    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588910    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588914    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588919    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588924    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588928    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588939    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588944    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588947    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588951    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588972    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588977    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:59:23.590653 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588981    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588986    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588990    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588994    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.588998    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589002    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589006    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589011    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589014    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589019    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589023    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589027    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589032    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589036    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589040    2547 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589044    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589048    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589052    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589056    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589060    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:59:23.591287 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589064    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589069    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589073    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589077    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589083    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589089    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589093    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589106    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589111    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589115    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589119    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589124    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589128    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589132    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589136    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589140    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589144    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589149    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589153    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:59:23.592173 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589160    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589166    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589171    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589175    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589180    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589184    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589189    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589193    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589197    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589202    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589207    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589211    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589215    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589219    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589223    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589229    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589233    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589236    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589243    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589247    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:59:23.592785 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589251    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589264    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589268    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589273    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589277    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589281    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589286    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589290    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.589294    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591003    2547 flags.go:64] FLAG: --address="0.0.0.0"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591023    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591040    2547 flags.go:64] FLAG: --anonymous-auth="true"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591047    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591054    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591060    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591066    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591074    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591079    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591084    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591090    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591096    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591101    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 01:59:23.593309 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591106    2547 flags.go:64] FLAG: --cgroup-root=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591111    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591116    2547 flags.go:64] FLAG: --client-ca-file=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591121    2547 flags.go:64] FLAG: --cloud-config=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591126    2547 flags.go:64] FLAG: --cloud-provider="external"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591131    2547 flags.go:64] FLAG: --cluster-dns="[]"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591144    2547 flags.go:64] FLAG: --cluster-domain=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591149    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591154    2547 flags.go:64] FLAG: --config-dir=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591159    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591164    2547 flags.go:64] FLAG: --container-log-max-files="5"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591171    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591185    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591191    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591197    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591202    2547 flags.go:64] FLAG: --contention-profiling="false"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591208    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591212    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591218    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591223    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591230    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591235    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591240    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591245    2547 flags.go:64] FLAG: --enable-load-reader="false"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591250    2547 flags.go:64] FLAG: --enable-server="true"
May 27 01:59:23.593951 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591255    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591266    2547 flags.go:64] FLAG: --event-burst="100"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591272    2547 flags.go:64] FLAG: --event-qps="50"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591277    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591282    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591287    2547 flags.go:64] FLAG: --eviction-hard=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591293    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591297    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591302    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591307    2547 flags.go:64] FLAG: --eviction-soft=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591311    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591316    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591322    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591327    2547 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591332    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591336    2547 flags.go:64] FLAG: --fail-swap-on="true"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591341    2547 flags.go:64] FLAG: --feature-gates=""
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591348    2547 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591353    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591358    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591372    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591377    2547 flags.go:64] FLAG: --healthz-port="10248"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591383    2547 flags.go:64] FLAG: --help="false"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591387    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-128-250.ec2.internal"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591392    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 01:59:23.594764 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591397    2547 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591403    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591409    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591415    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591420    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591425    2547 flags.go:64] FLAG: --image-service-endpoint=""
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591430    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591434    2547 flags.go:64] FLAG: --kube-api-burst="100"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591440    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591445    2547 flags.go:64] FLAG: --kube-api-qps="50"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591450    2547 flags.go:64] FLAG: --kube-reserved=""
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591455    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591460    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591465    2547 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591470    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591474    2547 flags.go:64] FLAG: --lock-file=""
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591479    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591484    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591490    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591499    2547 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591504    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591509    2547 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591513    2547 flags.go:64] FLAG: --logging-format="text"
May 27 01:59:23.595494 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591518    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591524    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591529    2547 flags.go:64] FLAG: --manifest-url=""
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591534    2547 flags.go:64] FLAG: --manifest-url-header=""
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591542    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591549    2547 flags.go:64] FLAG: --max-open-files="1000000"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591556    2547 flags.go:64] FLAG: --max-pods="110"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591561    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591566    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591571    2547 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591576    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591581    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591587    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591592    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591604    2547 flags.go:64] FLAG: --node-status-max-images="50"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591609    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591614    2547 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591619    2547 flags.go:64] FLAG: --pod-cidr=""
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591624    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591633    2547 flags.go:64] FLAG: --pod-manifest-path=""
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591638    2547 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591644    2547 flags.go:64] FLAG: --pods-per-core="0"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591649    2547 flags.go:64] FLAG: --port="10250"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591654    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 01:59:23.596108 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591658    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f30190631f1439ed"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591664    2547 flags.go:64] FLAG: --qos-reserved=""
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591669    2547 flags.go:64] FLAG: --read-only-port="10255"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591674    2547 flags.go:64] FLAG: --register-node="true"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591679    2547 flags.go:64] FLAG: --register-schedulable="true"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591684    2547 flags.go:64] FLAG: --register-with-taints=""
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591690    2547 flags.go:64] FLAG: --registry-burst="10"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591694    2547 flags.go:64] FLAG: --registry-qps="5"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591699    2547 flags.go:64] FLAG: --reserved-cpus=""
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591704    2547 flags.go:64] FLAG: --reserved-memory=""
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591710    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591715    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591721    2547 flags.go:64] FLAG: --rotate-certificates="false"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591727    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591732    2547 flags.go:64] FLAG: --runonce="false"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591737    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591742    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591747    2547 flags.go:64] FLAG: --seccomp-default="false"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591752    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591757    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591762    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591768    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591773    2547 flags.go:64] FLAG: --storage-driver-password="root"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591778    2547 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591782    2547 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591787    2547 flags.go:64] FLAG: --storage-driver-user="root"
May 27 01:59:23.596745 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591792    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591798    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591803    2547 flags.go:64] FLAG: --system-cgroups=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591807    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591817    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591822    2547 flags.go:64] FLAG: --tls-cert-file=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591826    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591837    2547 flags.go:64] FLAG: --tls-min-version=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591842    2547 flags.go:64] FLAG: --tls-private-key-file=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591846    2547 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591854    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591859    2547 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591864    2547 flags.go:64] FLAG: --v="2"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591871    2547 flags.go:64] FLAG: --version="false"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591878    2547 flags.go:64] FLAG: --vmodule=""
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591885    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.591890    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592073    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592082    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592088    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592093    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592099    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592105    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592110    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:59:23.597413 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592114    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592119    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592124    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592129    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592133    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592137    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592142    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592146    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592150    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592155    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592159    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592163    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592168    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592172    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592175    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592180    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592184    2547 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592188    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592198    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592203    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:59:23.598006 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592207    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592211    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592215    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592220    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592224    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592228    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592232    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592237    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592241    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592245    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592251    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592255    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592260    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592264    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592269    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592273    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592278    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592282    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592287    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:59:23.598518 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592291    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592298    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592304    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592309    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592313    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592318    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592323    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592329    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592333    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592338    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592342    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592348    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592352    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592357    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592361    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592365    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592369    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592373    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592377    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:59:23.599065 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592381    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592387    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592393    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592397    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592401    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592406    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592411    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592415    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592419    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592423    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592427    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592431    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592435    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592440    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592445    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592449    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592453    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592456    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592460    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:59:23.599594 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592465    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:59:23.600113 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.592470    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:59:23.600113 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.593361    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:59:23.600571 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.600553    2547 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 01:59:23.600600 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.600572    2547 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 01:59:23.600637 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600629    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:59:23.600637 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600636    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600641    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600644    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600647    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600650    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600654    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600656    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600659    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600662    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600665    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600667    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600670    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600678    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600681    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600685    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600689    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600692    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600695    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600697    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:59:23.600695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600700    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600704    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600707    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600710    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600712    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600715    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600717    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600720    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600722    2547 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600725    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600727    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600730    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600732    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600735    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600737    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600740    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600742    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600745    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600747    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600750    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600752    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:59:23.601177 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600755    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600757    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600760    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600762    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600765    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600775    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600779    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600782    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600785    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600788    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600791    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600793    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600796    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600799    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600802    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600805    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600807    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600810    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600812    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:59:23.601695 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600815    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600817    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600820    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600823    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600826    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600828    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600830    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600833    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600835    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600838    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600840    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600843    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600846    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600848    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600850    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600853    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600855    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600858    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600861    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600873    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:59:23.602186 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600875    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600878    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600881    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600883    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600886    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.600888    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.600893    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601018    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601024    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601027    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601030    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601033    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601036    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601038    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601041    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 01:59:23.602666 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601044    2547 feature_gate.go:328] unrecognized feature gate: Example
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601046    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601049    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601052    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601054    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601057    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601060    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601062    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601064    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601067    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601069    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601072    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601074    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601076    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601079    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601082    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601085    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601093    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601096    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601098    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 01:59:23.603054 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601101    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601103    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601106    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601109    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601111    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601114    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601117    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601119    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601122    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601124    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601127    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601129    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601132    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601135    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601139    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601141    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601144    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601147    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601149    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601152    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 01:59:23.603530 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601154    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601157    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601159    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601162    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601164    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601166    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601171    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601174    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601177    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601186    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601196    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601199    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601202    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601204    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601207    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601209    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601212    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601215    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601218    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601220    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 01:59:23.604145 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601223    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601225    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601228    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601231    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601233    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601236    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601238    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601241    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601244    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601246    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601249    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601251    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601254    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601256    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601259    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601261    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601264    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 01:59:23.604634 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:23.601266    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 01:59:23.605058 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.601271    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 01:59:23.605058 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.602247    2547 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 01:59:23.605058 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.604652    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 01:59:23.605867 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.605854    2547 server.go:1019] "Starting client certificate rotation"
May 27 01:59:23.605984 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.605953    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 01:59:23.606024 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.606011    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 01:59:23.634430 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.634412    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 01:59:23.639723 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.639699    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 01:59:23.655741 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.655724    2547 log.go:25] "Validated CRI v1 runtime API"
May 27 01:59:23.662594 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.662577    2547 log.go:25] "Validated CRI v1 image API"
May 27 01:59:23.664244 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.664227    2547 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 01:59:23.666540 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.666523    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 01:59:23.669111 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.669092    2547 fs.go:135] Filesystem UUIDs: map[04ac9353-bcea-42dd-be99-3f7490bd3194:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fba9760c-b95b-41ae-b0ab-1dd20b57c684:/dev/nvme0n1p4]
May 27 01:59:23.669168 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.669111    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 01:59:23.673640 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.673534    2547 manager.go:217] Machine: {Timestamp:2026-05-27 01:59:23.673050578 +0000 UTC m=+0.468294994 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095373 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26191bdc52f8f41409fcd6f784826c SystemUUID:ec26191b-dc52-f8f4-1409-fcd6f784826c BootID:2206aaff-00ba-4da8-ac7a-2fdf83fedfe2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:84:f3:9f:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:84:f3:9f:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:e1:f8:ea:e6:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 01:59:23.673640 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.673637    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 01:59:23.673761 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.673730    2547 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 01:59:23.676007 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.675984    2547 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 01:59:23.676166 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.676011    2547 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 01:59:23.676214 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.676176    2547 topology_manager.go:138] "Creating topology manager with none policy"
May 27 01:59:23.676214 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.676185    2547 container_manager_linux.go:306] "Creating device plugin manager"
May 27 01:59:23.676214 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.676193    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 01:59:23.677113 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.677103    2547 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 01:59:23.679045 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.679035    2547 state_mem.go:36] "Initialized new in-memory state store"
May 27 01:59:23.679170 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.679161    2547 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 01:59:23.681811 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.681801    2547 kubelet.go:491] "Attempting to sync node with API server"
May 27 01:59:23.681847 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.681816    2547 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 01:59:23.681847 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.681831    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 01:59:23.681847 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.681840    2547 kubelet.go:397] "Adding apiserver pod source"
May 27 01:59:23.681976 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.681848    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 01:59:23.683754 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.683741    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 01:59:23.683800 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.683765    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 01:59:23.688781 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.688761    2547 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 01:59:23.690684 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.690665    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hn5x"
May 27 01:59:23.691321 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.691304    2547 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 01:59:23.692361 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692347    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692367    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692377    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692386    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692398    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692406    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692415    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692423    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692434    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 01:59:23.692440 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692443    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 01:59:23.692678 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692456    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 01:59:23.692861 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.692851    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 01:59:23.693807 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.693796    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 01:59:23.693878 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.693811    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 01:59:23.696740 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.696721    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hn5x"
May 27 01:59:23.697214 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.697198    2547 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 01:59:23.697292 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.697239    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 01:59:23.697383 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.697365    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 01:59:23.698155 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.698142    2547 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 01:59:23.698211 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.698176    2547 server.go:1295] "Started kubelet"
May 27 01:59:23.698307 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.698257    2547 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 01:59:23.698342 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.698325    2547 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 01:59:23.698456 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.698423    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 01:59:23.699140 ip-10-0-128-250 systemd[1]: Started Kubernetes Kubelet.
May 27 01:59:23.700375 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.700355    2547 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 01:59:23.701331 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.701317    2547 server.go:317] "Adding debug handlers to kubelet server"
May 27 01:59:23.707580 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.707564    2547 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 01:59:23.707769 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.707755    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 01:59:23.707822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.707765    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 01:59:23.707875 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.707837    2547 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 01:59:23.707875 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.707846    2547 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 01:59:23.707992 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.707980    2547 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 01:59:23.708049 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.708038    2547 reconstruct.go:97] "Volume reconstruction finished"
May 27 01:59:23.708097 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.708050    2547 reconciler.go:26] "Reconciler: start to sync state"
May 27 01:59:23.708465 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.708447    2547 factory.go:55] Registering systemd factory
May 27 01:59:23.708465 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.708467    2547 factory.go:223] Registration of the systemd container factory successfully
May 27 01:59:23.709638 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.709563    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:23.709977 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.709941    2547 factory.go:153] Registering CRI-O factory
May 27 01:59:23.710059 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.709995    2547 factory.go:223] Registration of the crio container factory successfully
May 27 01:59:23.710059 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.710044    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 01:59:23.710173 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.710066    2547 factory.go:103] Registering Raw factory
May 27 01:59:23.710173 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.710083    2547 manager.go:1196] Started watching for new ooms in manager
May 27 01:59:23.710424 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.710410    2547 manager.go:319] Starting recovery of all containers
May 27 01:59:23.711186 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.711166    2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:23.715868 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.715843    2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
May 27 01:59:23.719834 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.719664    2547 manager.go:324] Recovery completed
May 27 01:59:23.724859 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.724846    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.726580 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.726564    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.726662 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.726597    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.726662 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.726613    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.727155 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.727140    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 01:59:23.727211 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.727155    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 01:59:23.727211 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.727174    2547 state_mem.go:36] "Initialized new in-memory state store"
May 27 01:59:23.731063 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.731052    2547 policy_none.go:49] "None policy: Start"
May 27 01:59:23.731111 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.731067    2547 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 01:59:23.731574 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.731564    2547 state_mem.go:35] "Initializing new in-memory state store"
May 27 01:59:23.768578 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.768565    2547 manager.go:341] "Starting Device Plugin manager"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.768590    2547 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.768601    2547 server.go:85] "Starting device plugin registration server"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.768834    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.768846    2547 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.768952    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.769042    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.769050    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.769570    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 01:59:23.790290 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.769612    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:23.839821 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.839762    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 01:59:23.840944 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.840928    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 01:59:23.841021 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.840950    2547 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 01:59:23.841021 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.840985    2547 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 01:59:23.841021 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.840993    2547 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 01:59:23.841156 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.841032    2547 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 01:59:23.843077 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.843057    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:23.869783 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.869749    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.870558 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.870534    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.870642 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.870563    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.870642 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.870579    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.870642 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.870608    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-250.ec2.internal"
May 27 01:59:23.881374 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.881356    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-250.ec2.internal"
May 27 01:59:23.881422 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.881377    2547 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-250.ec2.internal\": node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:23.903087 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.903068    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:23.941519 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.941489    2547 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"]
May 27 01:59:23.941616 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.941571    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.942522 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.942504    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.942599 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.942532    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.942599 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.942543    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.943701 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.943689    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.943848 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.943832    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:23.943925 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.943868    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.944384 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944368    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.944470 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944395    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.944470 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944397    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.944470 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944418    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.944470 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944428    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.944470 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.944404    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.945454 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.945442    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:23.945504 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.945466    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 01:59:23.946101 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.946086    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
May 27 01:59:23.946188 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.946105    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
May 27 01:59:23.946188 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:23.946114    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
May 27 01:59:23.974621 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.974600    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
May 27 01:59:23.979014 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:23.978995    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
May 27 01:59:24.003654 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.003634    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.009948 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.009924    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.010083 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.009952    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.010083 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.009989    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c725834ddadb524d8d4138c86d3aef9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"6c725834ddadb524d8d4138c86d3aef9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.104172 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.104081    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.110436 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110414    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.110521 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110447    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.110521 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110470    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c725834ddadb524d8d4138c86d3aef9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"6c725834ddadb524d8d4138c86d3aef9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.110521 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110510    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.110651 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110515    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c725834ddadb524d8d4138c86d3aef9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"6c725834ddadb524d8d4138c86d3aef9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.110651 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.110573    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8cb07c146cc155e6c4ec09a1d94c7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"2c8cb07c146cc155e6c4ec09a1d94c7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.204775 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.204736    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.277231 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.277197    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.282034 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.282017    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:24.305296 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.305267    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.405892 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.405802    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.506317 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.506291    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.605818 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.605776    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 01:59:24.606304 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.605937    2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 01:59:24.606304 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.605949    2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 01:59:24.606860 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.606842    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.699326 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.699261    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 01:54:23 +0000 UTC" deadline="2027-10-26 19:00:21.582915277 +0000 UTC"
May 27 01:59:24.699326 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.699287    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12425h0m56.88363021s"
May 27 01:59:24.707059 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.707043    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.708191 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.708174    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 01:59:24.718901 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.718878    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 01:59:24.750166 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.750143    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv4mb"
May 27 01:59:24.758591 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.758575    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv4mb"
May 27 01:59:24.808094 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.808068    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:24.887772 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:24.887732    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8cb07c146cc155e6c4ec09a1d94c7f.slice/crio-aca57911f684741788415d0ca6c71346956fee2d63978dd2a158a94579ca8384 WatchSource:0}: Error finding container aca57911f684741788415d0ca6c71346956fee2d63978dd2a158a94579ca8384: Status 404 returned error can't find the container with id aca57911f684741788415d0ca6c71346956fee2d63978dd2a158a94579ca8384
May 27 01:59:24.888000 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:24.887981    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c725834ddadb524d8d4138c86d3aef9.slice/crio-d3cf957367aa0c74336caa56629af5fbf60bf1da20a8a02ba168a6cc85803fdc WatchSource:0}: Error finding container d3cf957367aa0c74336caa56629af5fbf60bf1da20a8a02ba168a6cc85803fdc: Status 404 returned error can't find the container with id d3cf957367aa0c74336caa56629af5fbf60bf1da20a8a02ba168a6cc85803fdc
May 27 01:59:24.894583 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:24.894478    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 01:59:24.908826 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:24.908808    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:25.009257 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.009196    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:25.109613 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.109587    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
May 27 01:59:25.166984 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.166954    2547 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:25.198230 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.198204    2547 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:25.208419 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.208393    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
May 27 01:59:25.222003 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.221978    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 01:59:25.223202 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.223185    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
May 27 01:59:25.231592 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.231573    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 01:59:25.517614 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.517588    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:25.682588 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.682560    2547 apiserver.go:52] "Watching apiserver"
May 27 01:59:25.695150 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.695108    2547 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 01:59:25.695646 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.695614    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2xpff","openshift-cluster-node-tuning-operator/tuned-26rh2","openshift-dns/node-resolver-g2jbf","openshift-image-registry/node-ca-8xgxh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal","openshift-network-diagnostics/network-check-target-dh7bl","openshift-network-operator/iptables-alerter-7rpq7","kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5","openshift-multus/multus-additional-cni-plugins-2kwkw","openshift-multus/multus-nt54b","openshift-multus/network-metrics-daemon-59jjz","openshift-ovn-kubernetes/ovnkube-node-qpn4x"]
May 27 01:59:25.699227 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.699206    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:25.699345 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.699284    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:25.703238 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.703198    2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 01:59:25.703401 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.703378    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.705988 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.705562    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.705988 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.705638    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:25.705988 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.705667    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.705988 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.705725    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 01:59:25.705988 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.705827    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 01:59:25.706265 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.706146    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 01:59:25.706265 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.706153    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 01:59:25.706387 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.706368    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgxwr\""
May 27 01:59:25.707134 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.707109    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 01:59:25.707528 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.707506    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 01:59:25.708351 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708329    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 01:59:25.708452 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708356    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 01:59:25.708605 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708584    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 01:59:25.708682 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708665    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 01:59:25.708831 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708813    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rs54n\""
May 27 01:59:25.708889 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.708873    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 01:59:25.710122 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.710105    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.710476 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.710422    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.712876 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.712508    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mbrr7\""
May 27 01:59:25.712876 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.712645    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 01:59:25.713510 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713477    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 01:59:25.713597 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713550    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 01:59:25.713597 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713565    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 01:59:25.713719 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713699    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 01:59:25.713719 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713713    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 01:59:25.713825 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.713483    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sjzn9\""
May 27 01:59:25.714861 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.714839    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.715360 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.715342    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.717206 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717187    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nt54b"
May 27 01:59:25.717813 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717794    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 01:59:25.717899 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717823    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 01:59:25.717899 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717868    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n4dbc\""
May 27 01:59:25.718038 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717904    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 01:59:25.718038 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.717825    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k5pj\""
May 27 01:59:25.718226 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.718207    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 01:59:25.718294 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.718261    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 01:59:25.719427 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719408    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 01:59:25.719504 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719409    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-bin\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.719504 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719461    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.719504 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719489    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719514    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrnd\" (UniqueName: \"kubernetes.io/projected/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-kube-api-access-4qrnd\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719542    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719563    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-slash\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719586    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-var-lib-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719610    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-etc-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719632    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-node-log\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.719664 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719654    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-log-socket\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719673    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqpjq\""
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719677    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-host-slash\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719744    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719759    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-netd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719773    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-env-overrides\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719793    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tss4f\" (UniqueName: \"kubernetes.io/projected/9ecb3b81-dd0a-4207-b325-55392c86c92f-kube-api-access-tss4f\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719835    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-cnibin\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719880    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx26m\" (UniqueName: \"kubernetes.io/projected/756ca5d4-a51b-4367-a490-1bab1da5b262-kube-api-access-jx26m\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719905    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee79504-aff2-4ce6-b49a-fb19ddef6875-host\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719926    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-kubelet\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719948    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-systemd-units\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.719987    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-systemd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720012    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720039    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-script-lib\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720679 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720060    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.720679 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.720679 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720109    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee79504-aff2-4ce6-b49a-fb19ddef6875-serviceca\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.720679 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720133    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxb45\" (UniqueName: \"kubernetes.io/projected/8ee79504-aff2-4ce6-b49a-fb19ddef6875-kube-api-access-kxb45\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.720679 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720184    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-iptables-alerter-script\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.721028 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720703    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-config\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.721028 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720748    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovn-node-metrics-cert\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.721028 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-system-cni-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.721028 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-os-release\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.721028 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.720997    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.721287 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.721031    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7488k\" (UniqueName: \"kubernetes.io/projected/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-kube-api-access-7488k\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.721287 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.721059    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.721287 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.721088    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-netns\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.721287 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.721150    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-ovn\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.723841 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.723111    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.723841 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.723114    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.725482 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.725464    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 01:59:25.725667 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.725641    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 01:59:25.725992 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.725950    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 01:59:25.726139 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.726106    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 01:59:25.726211 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.726181    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q9mqk\""
May 27 01:59:25.726604 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.726588    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtxbx\""
May 27 01:59:25.759153 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.759125    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 01:54:24 +0000 UTC" deadline="2028-01-14 12:25:03.607818989 +0000 UTC"
May 27 01:59:25.759259 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.759153    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14338h25m37.848669163s"
May 27 01:59:25.809608 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.809587    2547 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 01:59:25.821376 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821356    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.821487 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821383    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.821487 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821404    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-etc-kubernetes\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.821487 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821423    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.821487 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821462    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.821676 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821569    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfszn\" (UniqueName: \"kubernetes.io/projected/b34de040-5a2e-4466-afc9-98b2e0cdf34c-kube-api-access-jfszn\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.821676 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821599    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7488k\" (UniqueName: \"kubernetes.io/projected/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-kube-api-access-7488k\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.821676 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821627    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.821676 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821649    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9914aa31-1af5-4a64-bb0b-8672c0df9c87-hosts-file\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.821676 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-system-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821700    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-multus\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821715    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821729    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-systemd\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821754    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821941    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.821994 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821973    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.821994    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-sys-fs\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822023    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-hostroot\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822079    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk8px\" (UniqueName: \"kubernetes.io/projected/875315df-898b-4417-a252-25ee51f3477a-kube-api-access-nk8px\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822088    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822099    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822122    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-var-lib-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822147    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-etc-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822149    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822171    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tss4f\" (UniqueName: \"kubernetes.io/projected/9ecb3b81-dd0a-4207-b325-55392c86c92f-kube-api-access-tss4f\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822199    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jx26m\" (UniqueName: \"kubernetes.io/projected/756ca5d4-a51b-4367-a490-1bab1da5b262-kube-api-access-jx26m\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822204    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-etc-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822199    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-var-lib-openvswitch\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822281    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756ca5d4-a51b-4367-a490-1bab1da5b262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-socket-dir-parent\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75pzr\" (UniqueName: \"kubernetes.io/projected/9914aa31-1af5-4a64-bb0b-8672c0df9c87-kube-api-access-75pzr\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822356    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-kubernetes\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822379    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5401109-df12-4bda-b2ec-20e423fd2201-konnectivity-ca\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822408    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-host-slash\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822444    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-host-slash\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822448    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-env-overrides\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822481    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee79504-aff2-4ce6-b49a-fb19ddef6875-host\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822511    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-os-release\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822547    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-cni-binary-copy\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822571    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-systemd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822617    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee79504-aff2-4ce6-b49a-fb19ddef6875-host\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822625    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822645    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-systemd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822666    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.822822 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822680    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-script-lib\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822710    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-socket-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822737    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjp6\" (UniqueName: \"kubernetes.io/projected/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kube-api-access-jsjp6\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822783    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5401109-df12-4bda-b2ec-20e423fd2201-agent-certs\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-tuned\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-cnibin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822856    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee79504-aff2-4ce6-b49a-fb19ddef6875-serviceca\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822883    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxb45\" (UniqueName: \"kubernetes.io/projected/8ee79504-aff2-4ce6-b49a-fb19ddef6875-kube-api-access-kxb45\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822907    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-env-overrides\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-var-lib-kubelet\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.822975    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-tmp\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823003    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-iptables-alerter-script\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823030    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-config\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823074    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovn-node-metrics-cert\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823106    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-system-cni-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823132    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-os-release\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823173    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-script-lib\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.823615 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823184    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-system-cni-dir\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823213    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-run\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823239    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-multus-daemon-config\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823246    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-os-release\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823272    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-netns\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823295    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-conf-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823325    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-multus-certs\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823362    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-netns\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823389    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-ovn\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823415    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9914aa31-1af5-4a64-bb0b-8672c0df9c87-tmp-dir\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823439    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-sys\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823465    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-lib-modules\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823511    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-netns\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823522    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee79504-aff2-4ce6-b49a-fb19ddef6875-serviceca\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823522    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823551    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-run-ovn\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823562    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-iptables-alerter-script\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823617    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-bin\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.824330 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823660    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-bin\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823673    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-device-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823725    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823764    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-bin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823800    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-registration-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823840    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823878    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrnd\" (UniqueName: \"kubernetes.io/projected/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-kube-api-access-4qrnd\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.823944    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-slash\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824009    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovnkube-config\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824016    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-node-log\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824016    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-slash\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824052    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-log-socket\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824077    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-node-log\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.824112    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824121    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-log-socket\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824120    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824077    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825065 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824165    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-netd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.824202    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:26.324165024 +0000 UTC m=+3.119409442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824222    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-cni-netd\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824231    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysconfig\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824258    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-cnibin\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824283    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-conf\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824308    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-host\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-k8s-cni-cncf-io\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824338    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756ca5d4-a51b-4367-a490-1bab1da5b262-cnibin\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824362    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-kubelet\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824402    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-systemd-units\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824425    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-host-kubelet\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-modprobe-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824467    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-kubelet\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.825619 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.824467    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ecb3b81-dd0a-4207-b325-55392c86c92f-systemd-units\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.827323 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.827304    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ecb3b81-dd0a-4207-b325-55392c86c92f-ovn-node-metrics-cert\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.830885 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.830789    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:25.830885 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.830813    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:25.830885 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.830825    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:25.831064 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:25.830890    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:26.330873597 +0000 UTC m=+3.126118010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:25.831895 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.831870    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7488k\" (UniqueName: \"kubernetes.io/projected/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-kube-api-access-7488k\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:25.832553 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.832532    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx26m\" (UniqueName: \"kubernetes.io/projected/756ca5d4-a51b-4367-a490-1bab1da5b262-kube-api-access-jx26m\") pod \"multus-additional-cni-plugins-2kwkw\" (UID: \"756ca5d4-a51b-4367-a490-1bab1da5b262\") " pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:25.834159 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.834134    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tss4f\" (UniqueName: \"kubernetes.io/projected/9ecb3b81-dd0a-4207-b325-55392c86c92f-kube-api-access-tss4f\") pod \"ovnkube-node-qpn4x\" (UID: \"9ecb3b81-dd0a-4207-b325-55392c86c92f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:25.835273 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.835243    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrnd\" (UniqueName: \"kubernetes.io/projected/e9b2b5aa-902d-4f5f-9033-f818a0f2956e-kube-api-access-4qrnd\") pod \"iptables-alerter-7rpq7\" (UID: \"e9b2b5aa-902d-4f5f-9033-f818a0f2956e\") " pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:25.835415 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.835399    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxb45\" (UniqueName: \"kubernetes.io/projected/8ee79504-aff2-4ce6-b49a-fb19ddef6875-kube-api-access-kxb45\") pod \"node-ca-8xgxh\" (UID: \"8ee79504-aff2-4ce6-b49a-fb19ddef6875\") " pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:25.847496 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.847456    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" event={"ID":"6c725834ddadb524d8d4138c86d3aef9","Type":"ContainerStarted","Data":"d3cf957367aa0c74336caa56629af5fbf60bf1da20a8a02ba168a6cc85803fdc"}
May 27 01:59:25.848512 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.848490    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"2c8cb07c146cc155e6c4ec09a1d94c7f","Type":"ContainerStarted","Data":"aca57911f684741788415d0ca6c71346956fee2d63978dd2a158a94579ca8384"}
May 27 01:59:25.925544 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925519    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-multus\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925544 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925550    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-systemd\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925567    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925612    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-multus\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925637    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-systemd\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925658    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-sys-fs\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925678    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925691    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925706    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-sys-fs\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925733    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-hostroot\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925757    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-hostroot\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925759    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk8px\" (UniqueName: \"kubernetes.io/projected/875315df-898b-4417-a252-25ee51f3477a-kube-api-access-nk8px\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.925787 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925795    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-socket-dir-parent\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925738    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925816    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75pzr\" (UniqueName: \"kubernetes.io/projected/9914aa31-1af5-4a64-bb0b-8672c0df9c87-kube-api-access-75pzr\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925838    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-kubernetes\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925852    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-socket-dir-parent\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925857    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5401109-df12-4bda-b2ec-20e423fd2201-konnectivity-ca\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925914    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-os-release\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925932    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-kubernetes\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.925939    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-cni-binary-copy\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926013    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-os-release\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926012    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-socket-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926057    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjp6\" (UniqueName: \"kubernetes.io/projected/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kube-api-access-jsjp6\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926080    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5401109-df12-4bda-b2ec-20e423fd2201-agent-certs\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-tuned\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926126    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-cnibin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926153    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-var-lib-kubelet\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926170    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-socket-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926176    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-tmp\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.926317 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926227    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-run\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926256    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-multus-daemon-config\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926281    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-netns\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926306    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-conf-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926328    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-multus-certs\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926339    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-run\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926356    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9914aa31-1af5-4a64-bb0b-8672c0df9c87-tmp-dir\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926382    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-sys\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926391    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-netns\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926407    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-lib-modules\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926432    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-cni-binary-copy\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926475    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-multus-certs\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926499    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-cnibin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926515    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-device-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926519    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5401109-df12-4bda-b2ec-20e423fd2201-konnectivity-ca\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926524    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-lib-modules\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926562    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926588    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-bin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927143 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926602    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-var-lib-kubelet\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926630    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-registration-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926653    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-device-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926693    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-multus-conf-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926680    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysconfig\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926747    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-sys\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926773    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-conf\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926790    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysconfig\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926798    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-host\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926802    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9914aa31-1af5-4a64-bb0b-8672c0df9c87-tmp-dir\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926847    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/875315df-898b-4417-a252-25ee51f3477a-multus-daemon-config\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926906    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-registration-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926912    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-cni-bin\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926932    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-sysctl-conf\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926939    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-k8s-cni-cncf-io\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926991    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-modprobe-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926996    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-run-k8s-cni-cncf-io\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.926994    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.927746 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927037    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-host\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927067    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-kubelet\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927079    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-modprobe-d\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927100    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-host-var-lib-kubelet\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927106    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-etc-kubernetes\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927137    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927168    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfszn\" (UniqueName: \"kubernetes.io/projected/b34de040-5a2e-4466-afc9-98b2e0cdf34c-kube-api-access-jfszn\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927195    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9914aa31-1af5-4a64-bb0b-8672c0df9c87-hosts-file\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927199    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-etc-kubernetes\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927221    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-system-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927229    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927289    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9914aa31-1af5-4a64-bb0b-8672c0df9c87-hosts-file\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.927303    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/875315df-898b-4417-a252-25ee51f3477a-system-cni-dir\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.928328 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.928318    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-tmp\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.928687 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.928409    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b34de040-5a2e-4466-afc9-98b2e0cdf34c-etc-tuned\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.928687 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.928509    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5401109-df12-4bda-b2ec-20e423fd2201-agent-certs\") pod \"konnectivity-agent-2xpff\" (UID: \"b5401109-df12-4bda-b2ec-20e423fd2201\") " pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:25.934566 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.934539    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjp6\" (UniqueName: \"kubernetes.io/projected/b9a48f6e-09b7-4b6c-a429-4ab8895087aa-kube-api-access-jsjp6\") pod \"aws-ebs-csi-driver-node-kpsr5\" (UID: \"b9a48f6e-09b7-4b6c-a429-4ab8895087aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:25.934987 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.934939    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk8px\" (UniqueName: \"kubernetes.io/projected/875315df-898b-4417-a252-25ee51f3477a-kube-api-access-nk8px\") pod \"multus-nt54b\" (UID: \"875315df-898b-4417-a252-25ee51f3477a\") " pod="openshift-multus/multus-nt54b"
May 27 01:59:25.935162 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.935143    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfszn\" (UniqueName: \"kubernetes.io/projected/b34de040-5a2e-4466-afc9-98b2e0cdf34c-kube-api-access-jfszn\") pod \"tuned-26rh2\" (UID: \"b34de040-5a2e-4466-afc9-98b2e0cdf34c\") " pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:25.935454 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:25.935431    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75pzr\" (UniqueName: \"kubernetes.io/projected/9914aa31-1af5-4a64-bb0b-8672c0df9c87-kube-api-access-75pzr\") pod \"node-resolver-g2jbf\" (UID: \"9914aa31-1af5-4a64-bb0b-8672c0df9c87\") " pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:26.017528 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.017495    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:26.025760 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.025698    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kwkw"
May 27 01:59:26.039397 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.039373    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rpq7"
May 27 01:59:26.042990 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.042970    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xgxh"
May 27 01:59:26.049550 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.049523    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:26.056045 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.056030    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5"
May 27 01:59:26.063547 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.063526    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nt54b"
May 27 01:59:26.070033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.070007    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g2jbf"
May 27 01:59:26.076518 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.076502    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26rh2"
May 27 01:59:26.330233 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.330156    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:26.330381 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.330320    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:26.330474 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.330397    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:27.330376543 +0000 UTC m=+4.125620946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:26.430469 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.430445    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:26.430581 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.430467    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9914aa31_1af5_4a64_bb0b_8672c0df9c87.slice/crio-594d81a8ba7faa1998c2c4fc1a1c8bcc1dba16de0c4e0c75f9baf719a7018eda WatchSource:0}: Error finding container 594d81a8ba7faa1998c2c4fc1a1c8bcc1dba16de0c4e0c75f9baf719a7018eda: Status 404 returned error can't find the container with id 594d81a8ba7faa1998c2c4fc1a1c8bcc1dba16de0c4e0c75f9baf719a7018eda
May 27 01:59:26.430641 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.430626    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:26.430680 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.430649    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:26.430680 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.430661    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:26.430742 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:26.430724    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:27.430704282 +0000 UTC m=+4.225948701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:26.431430 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.431405    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecb3b81_dd0a_4207_b325_55392c86c92f.slice/crio-6038e2cd4e938c41fd8bb498ed81af7dc2addbbe2459a88c782011740675a26e WatchSource:0}: Error finding container 6038e2cd4e938c41fd8bb498ed81af7dc2addbbe2459a88c782011740675a26e: Status 404 returned error can't find the container with id 6038e2cd4e938c41fd8bb498ed81af7dc2addbbe2459a88c782011740675a26e
May 27 01:59:26.432659 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.432632    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756ca5d4_a51b_4367_a490_1bab1da5b262.slice/crio-5fb8b13d99519f7c824afc6c977f2be582ab287772739d4f56a8202e5f08d726 WatchSource:0}: Error finding container 5fb8b13d99519f7c824afc6c977f2be582ab287772739d4f56a8202e5f08d726: Status 404 returned error can't find the container with id 5fb8b13d99519f7c824afc6c977f2be582ab287772739d4f56a8202e5f08d726
May 27 01:59:26.435365 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.435342    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b2b5aa_902d_4f5f_9033_f818a0f2956e.slice/crio-4fc7088c773a5f07dcc0abdf95a30a7498947738be5bd772b21f39fee5c4c0e3 WatchSource:0}: Error finding container 4fc7088c773a5f07dcc0abdf95a30a7498947738be5bd772b21f39fee5c4c0e3: Status 404 returned error can't find the container with id 4fc7088c773a5f07dcc0abdf95a30a7498947738be5bd772b21f39fee5c4c0e3
May 27 01:59:26.436655 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.436626    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34de040_5a2e_4466_afc9_98b2e0cdf34c.slice/crio-58d2539ffbe964ff2f36b24deb150c16d89b08fd92e52c6a0a91ed0397fd55f4 WatchSource:0}: Error finding container 58d2539ffbe964ff2f36b24deb150c16d89b08fd92e52c6a0a91ed0397fd55f4: Status 404 returned error can't find the container with id 58d2539ffbe964ff2f36b24deb150c16d89b08fd92e52c6a0a91ed0397fd55f4
May 27 01:59:26.437171 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.437051    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875315df_898b_4417_a252_25ee51f3477a.slice/crio-66eee4d6526e137db7f293200052853ae8cc66be6aa972b2188688424044b260 WatchSource:0}: Error finding container 66eee4d6526e137db7f293200052853ae8cc66be6aa972b2188688424044b260: Status 404 returned error can't find the container with id 66eee4d6526e137db7f293200052853ae8cc66be6aa972b2188688424044b260
May 27 01:59:26.438071 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.437841    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a48f6e_09b7_4b6c_a429_4ab8895087aa.slice/crio-9395eee5e0290a53fbe71d8c3a8b04a85bc5ee4003918bbe53763c7b02984e79 WatchSource:0}: Error finding container 9395eee5e0290a53fbe71d8c3a8b04a85bc5ee4003918bbe53763c7b02984e79: Status 404 returned error can't find the container with id 9395eee5e0290a53fbe71d8c3a8b04a85bc5ee4003918bbe53763c7b02984e79
May 27 01:59:26.440391 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.439078    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee79504_aff2_4ce6_b49a_fb19ddef6875.slice/crio-35f3e46389d7c37b7645fa962a1d2e62b12701039dd41109ffce206e25f1e5c1 WatchSource:0}: Error finding container 35f3e46389d7c37b7645fa962a1d2e62b12701039dd41109ffce206e25f1e5c1: Status 404 returned error can't find the container with id 35f3e46389d7c37b7645fa962a1d2e62b12701039dd41109ffce206e25f1e5c1
May 27 01:59:26.440391 ip-10-0-128-250 kubenswrapper[2547]: W0527 01:59:26.440335    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5401109_df12_4bda_b2ec_20e423fd2201.slice/crio-0e484a3477cae950c987a30951e86cf09c924ef38db7b07fa86e88158623adbc WatchSource:0}: Error finding container 0e484a3477cae950c987a30951e86cf09c924ef38db7b07fa86e88158623adbc: Status 404 returned error can't find the container with id 0e484a3477cae950c987a30951e86cf09c924ef38db7b07fa86e88158623adbc
May 27 01:59:26.760296 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.760106    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 01:54:24 +0000 UTC" deadline="2028-02-10 07:22:10.308570408 +0000 UTC"
May 27 01:59:26.760641 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.760298    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14981h22m43.54827718s"
May 27 01:59:26.854497 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.854399    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26rh2" event={"ID":"b34de040-5a2e-4466-afc9-98b2e0cdf34c","Type":"ContainerStarted","Data":"58d2539ffbe964ff2f36b24deb150c16d89b08fd92e52c6a0a91ed0397fd55f4"}
May 27 01:59:26.860010 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.859980    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rpq7" event={"ID":"e9b2b5aa-902d-4f5f-9033-f818a0f2956e","Type":"ContainerStarted","Data":"4fc7088c773a5f07dcc0abdf95a30a7498947738be5bd772b21f39fee5c4c0e3"}
May 27 01:59:26.865559 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.865465    2547 generic.go:358] "Generic (PLEG): container finished" podID="2c8cb07c146cc155e6c4ec09a1d94c7f" containerID="39a9b6ff4893b13292f9327d935632b89e93506a6a9e6e789bc2de0353092e86" exitCode=0
May 27 01:59:26.865905 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.865693    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"2c8cb07c146cc155e6c4ec09a1d94c7f","Type":"ContainerDied","Data":"39a9b6ff4893b13292f9327d935632b89e93506a6a9e6e789bc2de0353092e86"}
May 27 01:59:26.872402 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.872344    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xgxh" event={"ID":"8ee79504-aff2-4ce6-b49a-fb19ddef6875","Type":"ContainerStarted","Data":"35f3e46389d7c37b7645fa962a1d2e62b12701039dd41109ffce206e25f1e5c1"}
May 27 01:59:26.875995 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.875954    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nt54b" event={"ID":"875315df-898b-4417-a252-25ee51f3477a","Type":"ContainerStarted","Data":"66eee4d6526e137db7f293200052853ae8cc66be6aa972b2188688424044b260"}
May 27 01:59:26.880532 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.880477    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5" event={"ID":"b9a48f6e-09b7-4b6c-a429-4ab8895087aa","Type":"ContainerStarted","Data":"9395eee5e0290a53fbe71d8c3a8b04a85bc5ee4003918bbe53763c7b02984e79"}
May 27 01:59:26.883466 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.883435    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerStarted","Data":"5fb8b13d99519f7c824afc6c977f2be582ab287772739d4f56a8202e5f08d726"}
May 27 01:59:26.890973 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.888874    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"6038e2cd4e938c41fd8bb498ed81af7dc2addbbe2459a88c782011740675a26e"}
May 27 01:59:26.893749 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.892647    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g2jbf" event={"ID":"9914aa31-1af5-4a64-bb0b-8672c0df9c87","Type":"ContainerStarted","Data":"594d81a8ba7faa1998c2c4fc1a1c8bcc1dba16de0c4e0c75f9baf719a7018eda"}
May 27 01:59:26.897777 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.897227    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" event={"ID":"6c725834ddadb524d8d4138c86d3aef9","Type":"ContainerStarted","Data":"050d8940c5389f425e7eed27c985b124aaf10c98020d32c3b1a06de750c004b3"}
May 27 01:59:26.899578 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:26.899531    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xpff" event={"ID":"b5401109-df12-4bda-b2ec-20e423fd2201","Type":"ContainerStarted","Data":"0e484a3477cae950c987a30951e86cf09c924ef38db7b07fa86e88158623adbc"}
May 27 01:59:27.335558 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.335472    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:27.335727 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.335641    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:27.335727 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.335704    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:29.335686477 +0000 UTC m=+6.130930879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:27.436269 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.436226    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:27.436430 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.436415    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:27.436496 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.436436    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:27.436496 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.436451    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:27.436608 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.436537    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:29.43651751 +0000 UTC m=+6.231761929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:27.843606 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.843123    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:27.843606 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.843159    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:27.843606 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.843260    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:27.843606 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:27.843369    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:27.914058 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.914009    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"2c8cb07c146cc155e6c4ec09a1d94c7f","Type":"ContainerStarted","Data":"c96985a7ba8bd609a4eb1d9c9ddb5c9dca53d17b79e65fb58a97cca688f60400"}
May 27 01:59:27.929833 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:27.929778    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" podStartSLOduration=2.929761686 podStartE2EDuration="2.929761686s" podCreationTimestamp="2026-05-27 01:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 01:59:26.923700457 +0000 UTC m=+3.718944883" watchObservedRunningTime="2026-05-27 01:59:27.929761686 +0000 UTC m=+4.725006112"
May 27 01:59:29.352393 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:29.351786    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:29.352393 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.351984    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:29.352393 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.352053    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:33.352030105 +0000 UTC m=+10.147274520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:29.452866 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:29.452784    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:29.453050 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.452943    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:29.453050 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.452987    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:29.453050 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.453001    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:29.453214 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.453067    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:33.453047454 +0000 UTC m=+10.248291864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:29.842238 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:29.842161    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:29.842391 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.842293    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:29.842774 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:29.842752    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:29.842897 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:29.842855    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:31.841931 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:31.841895    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:31.841931 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:31.841920    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:31.842442 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:31.842042    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:31.842442 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:31.842163    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:33.385534 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:33.385498    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:33.386013 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.385663    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:33.386013 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.385734    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:41.385713559 +0000 UTC m=+18.180957984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:33.487336 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:33.486769    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:33.487336 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.486980    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:33.487336 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.486998    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:33.487336 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.487011    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:33.487336 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.487064    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:41.487046232 +0000 UTC m=+18.282290640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:33.843058 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:33.842906    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:33.843058 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.843013    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:33.843456 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:33.843313    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:33.843456 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:33.843419    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:35.841569 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:35.841536    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:35.841569 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:35.841538    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:35.842201 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:35.841668    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:35.842201 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:35.841790    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:37.841690 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:37.841654    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:37.842165 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:37.841781    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:37.842165 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:37.841824    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:37.842165 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:37.841916    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:39.841810 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:39.841771    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:39.842160 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:39.841804    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:39.842160 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:39.841870    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:39.842160 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:39.841915    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:41.449142 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:41.449104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:41.449531 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.449229    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:41.449531 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.449284    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 01:59:57.449266985 +0000 UTC m=+34.244511407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:41.550187 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:41.550147    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:41.550347 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.550326    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:41.550396 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.550351    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:41.550396 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.550365    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:41.550487 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.550425    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:57.550405245 +0000 UTC m=+34.345649653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:41.842064 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:41.842030    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:41.842234 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:41.842070    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:41.842234 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.842152    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:41.842347 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:41.842278    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:43.842515 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:43.842483    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:43.842909 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:43.842622    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:43.842909 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:43.842684    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:43.842909 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:43.842793    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:44.947896 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.947697    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xgxh" event={"ID":"8ee79504-aff2-4ce6-b49a-fb19ddef6875","Type":"ContainerStarted","Data":"c892844dde053570acb5d12194e9c733c333650a0b0e4eec19932094323d9eba"}
May 27 01:59:44.949074 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.949053    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nt54b" event={"ID":"875315df-898b-4417-a252-25ee51f3477a","Type":"ContainerStarted","Data":"4459e4af371037ad7b13633bab4061ca3697f7207985cbdeb75fdda1d6587b0a"}
May 27 01:59:44.950268 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.950250    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5" event={"ID":"b9a48f6e-09b7-4b6c-a429-4ab8895087aa","Type":"ContainerStarted","Data":"924f72cb0cb96da07ac84bf03e4458767532d57bce9b8ecec23ab4add9559aab"}
May 27 01:59:44.951535 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.951514    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="9a10d30d520e0cebc1c0ef12fbb203d8a89f063655b65464d200bdd47f1f0544" exitCode=0
May 27 01:59:44.951601 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.951569    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"9a10d30d520e0cebc1c0ef12fbb203d8a89f063655b65464d200bdd47f1f0544"}
May 27 01:59:44.952928 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.952905    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"f91d88562f5ba8157c83b34e493ddfdea7dd3259771ce075a7700eecc6a9b9b4"}
May 27 01:59:44.954581 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.954525    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g2jbf" event={"ID":"9914aa31-1af5-4a64-bb0b-8672c0df9c87","Type":"ContainerStarted","Data":"d3aaf2d0084b144b1c9876f40982d104a8ba1bf56366be7bca33d9fa7aad2f7e"}
May 27 01:59:44.955855 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.955831    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xpff" event={"ID":"b5401109-df12-4bda-b2ec-20e423fd2201","Type":"ContainerStarted","Data":"796352bb9e8d41bdbe2f6d9d3ccf4e0371beca696fbfcbff579754f9d3b26e56"}
May 27 01:59:44.957179 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.957159    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26rh2" event={"ID":"b34de040-5a2e-4466-afc9-98b2e0cdf34c","Type":"ContainerStarted","Data":"567bbfda94de72827495a6d8b6b1afd2a5ddb0ebd3ed0e4928a7c67ac9e5d9f6"}
May 27 01:59:44.963088 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.963039    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8xgxh" podStartSLOduration=3.017004876 podStartE2EDuration="20.96302976s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.441639693 +0000 UTC m=+3.236884097" lastFinishedPulling="2026-05-27 01:59:44.387664566 +0000 UTC m=+21.182908981" observedRunningTime="2026-05-27 01:59:44.962801617 +0000 UTC m=+21.758046042" watchObservedRunningTime="2026-05-27 01:59:44.96302976 +0000 UTC m=+21.758274184"
May 27 01:59:44.963203 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.963127    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" podStartSLOduration=19.963118949 podStartE2EDuration="19.963118949s" podCreationTimestamp="2026-05-27 01:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 01:59:27.930870606 +0000 UTC m=+4.726115033" watchObservedRunningTime="2026-05-27 01:59:44.963118949 +0000 UTC m=+21.758363379"
May 27 01:59:44.977296 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:44.977261    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-g2jbf" podStartSLOduration=2.9531779179999997 podStartE2EDuration="20.977249128s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.432479513 +0000 UTC m=+3.227723923" lastFinishedPulling="2026-05-27 01:59:44.456550713 +0000 UTC m=+21.251795133" observedRunningTime="2026-05-27 01:59:44.976822339 +0000 UTC m=+21.772066825" watchObservedRunningTime="2026-05-27 01:59:44.977249128 +0000 UTC m=+21.772493553"
May 27 01:59:45.015310 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.015271    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26rh2" podStartSLOduration=2.994710579 podStartE2EDuration="21.015258633s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.438174485 +0000 UTC m=+3.233418889" lastFinishedPulling="2026-05-27 01:59:44.458722535 +0000 UTC m=+21.253966943" observedRunningTime="2026-05-27 01:59:44.992804397 +0000 UTC m=+21.788048823" watchObservedRunningTime="2026-05-27 01:59:45.015258633 +0000 UTC m=+21.810503058"
May 27 01:59:45.037093 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.037068    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:45.037542 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.037525    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:45.049347 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.049308    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nt54b" podStartSLOduration=2.672132439 podStartE2EDuration="21.049295101s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.439709487 +0000 UTC m=+3.234953893" lastFinishedPulling="2026-05-27 01:59:44.816872136 +0000 UTC m=+21.612116555" observedRunningTime="2026-05-27 01:59:45.049177135 +0000 UTC m=+21.844421560" watchObservedRunningTime="2026-05-27 01:59:45.049295101 +0000 UTC m=+21.844539525"
May 27 01:59:45.049603 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.049578    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2xpff" podStartSLOduration=3.059395072 podStartE2EDuration="21.049572366s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.441900471 +0000 UTC m=+3.237144888" lastFinishedPulling="2026-05-27 01:59:44.432077767 +0000 UTC m=+21.227322182" observedRunningTime="2026-05-27 01:59:45.028950351 +0000 UTC m=+21.824194776" watchObservedRunningTime="2026-05-27 01:59:45.049572366 +0000 UTC m=+21.844816791"
May 27 01:59:45.841857 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.841636    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:45.842025 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.841667    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:45.842025 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:45.841991    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:45.842144 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:45.842029    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:45.905535 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.905482    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 01:59:45.959626 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.959601    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rpq7" event={"ID":"e9b2b5aa-902d-4f5f-9033-f818a0f2956e","Type":"ContainerStarted","Data":"67a1a2d190cb3fd66fe33fd82ee46f1399e9ce7ff61bbdf0ef83541a2289927c"}
May 27 01:59:45.961315 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.961289    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5" event={"ID":"b9a48f6e-09b7-4b6c-a429-4ab8895087aa","Type":"ContainerStarted","Data":"d829caf593d704d83122e4b853b3ed3e9ce9e0f58c6e9e23e9cee5fdac1328fe"}
May 27 01:59:45.963898 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.963853    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 01:59:45.964288 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964268    2547 generic.go:358] "Generic (PLEG): container finished" podID="9ecb3b81-dd0a-4207-b325-55392c86c92f" containerID="a0a82e957845c7e0fd85f051f50788cccdaf3d68fe27b2fcbd67cad30822f20b" exitCode=1
May 27 01:59:45.964434 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964354    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"e956da302b1a5be27cc7008e84552e915dd5480420d71bfacd99f596c85b9690"}
May 27 01:59:45.964434 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964384    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"afc1ac0d1a61305ff1f648b6e16a1be97b0d5d8297fd37ce2a75a83e3c01b573"}
May 27 01:59:45.964434 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964399    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"512e956a27f432ac841b16b0944634ad5ffdb0c750e37b62f2dcd2eeb11b5201"}
May 27 01:59:45.964434 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964411    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"6724aa136464118eb5a6797e0d02575ded4b1c721914a479751414f6cb47664d"}
May 27 01:59:45.964434 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:45.964426    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerDied","Data":"a0a82e957845c7e0fd85f051f50788cccdaf3d68fe27b2fcbd67cad30822f20b"}
May 27 01:59:46.783900 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.783808    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T01:59:45.905502788Z","UUID":"63d60e07-9684-4a3a-a1b5-21b6f2aebb24","Handler":null,"Name":"","Endpoint":""}
May 27 01:59:46.785546 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.785522    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 01:59:46.785546 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.785550    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 01:59:46.967931 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.967899    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5" event={"ID":"b9a48f6e-09b7-4b6c-a429-4ab8895087aa","Type":"ContainerStarted","Data":"6482559d6d37979d06588306f86d77a6411cfe174e6f990976a946b4e019eaef"}
May 27 01:59:46.968360 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.968066    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 01:59:46.985110 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:46.985067    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rpq7" podStartSLOduration=4.958414587 podStartE2EDuration="22.985055663s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.436827581 +0000 UTC m=+3.232071984" lastFinishedPulling="2026-05-27 01:59:44.463468654 +0000 UTC m=+21.258713060" observedRunningTime="2026-05-27 01:59:46.984786889 +0000 UTC m=+23.780031315" watchObservedRunningTime="2026-05-27 01:59:46.985055663 +0000 UTC m=+23.780300091"
May 27 01:59:47.002818 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:47.002776    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kpsr5" podStartSLOduration=2.635903951 podStartE2EDuration="23.002766617s" podCreationTimestamp="2026-05-27 01:59:24 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.439812541 +0000 UTC m=+3.235056955" lastFinishedPulling="2026-05-27 01:59:46.806675204 +0000 UTC m=+23.601919621" observedRunningTime="2026-05-27 01:59:47.002527271 +0000 UTC m=+23.797771697" watchObservedRunningTime="2026-05-27 01:59:47.002766617 +0000 UTC m=+23.798011042"
May 27 01:59:47.844938 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:47.844761    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:47.845120 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:47.844767    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:47.845120 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:47.845067    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:47.845120 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:47.845109    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:48.973639 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:48.973613    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 01:59:48.974087 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:48.973993    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"57a96dda0a79e88ce60fd04517a47b1a4e1b0165a12e7c54ebc4cac4a260c1b6"}
May 27 01:59:49.103662 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.103634    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:49.103778 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.103758    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 01:59:49.104148 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.104126    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2xpff"
May 27 01:59:49.843651 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.843631    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:49.843825 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.843631    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:49.843825 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:49.843732    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:49.843825 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:49.843790    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:49.978464 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.978439    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="f9fe019e75da13c01a3934cf59d897ffd945533e0798e583e5741ee8c3bc1887" exitCode=0
May 27 01:59:49.978946 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:49.978528    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"f9fe019e75da13c01a3934cf59d897ffd945533e0798e583e5741ee8c3bc1887"}
May 27 01:59:51.844059 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.843877    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:51.844517 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.843879    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:51.844517 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:51.844112    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:51.844517 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:51.844238    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:51.983883 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.983858    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="3e754dfa0eec471d46d0979b1b372d77993cbf6de192f93eaa8d3d0ec30a5db2" exitCode=0
May 27 01:59:51.984003 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.983928    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"3e754dfa0eec471d46d0979b1b372d77993cbf6de192f93eaa8d3d0ec30a5db2"}
May 27 01:59:51.987147 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.987131    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 01:59:51.987469 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.987449    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"dcd7e83d714ecf536bdd7a80adc9c9a0d65fe85a654165a2f76bbbd4bcd2ed15"}
May 27 01:59:51.987728 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.987708    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:51.987837 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:51.987822    2547 scope.go:117] "RemoveContainer" containerID="a0a82e957845c7e0fd85f051f50788cccdaf3d68fe27b2fcbd67cad30822f20b"
May 27 01:59:52.003483 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:52.003466    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:52.993934 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:52.993910    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 01:59:52.994362 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:52.994292    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" event={"ID":"9ecb3b81-dd0a-4207-b325-55392c86c92f","Type":"ContainerStarted","Data":"c85bb4a0a8dcaed4475b52202565f9db70d68ce28ebd29b5700e84c9ae114808"}
May 27 01:59:52.994761 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:52.994735    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:52.994872 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:52.994838    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:53.011031 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.011010    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 01:59:53.024351 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.024308    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x" podStartSLOduration=11.980534135 podStartE2EDuration="30.024297049s" podCreationTimestamp="2026-05-27 01:59:23 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.433615075 +0000 UTC m=+3.228859483" lastFinishedPulling="2026-05-27 01:59:44.477377995 +0000 UTC m=+21.272622397" observedRunningTime="2026-05-27 01:59:53.022912348 +0000 UTC m=+29.818156772" watchObservedRunningTime="2026-05-27 01:59:53.024297049 +0000 UTC m=+29.819541599"
May 27 01:59:53.277454 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.277237    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dh7bl"]
May 27 01:59:53.277599 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.277566    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:53.277704 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:53.277671    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:53.280070 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.280047    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-59jjz"]
May 27 01:59:53.280182 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.280169    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:53.280301 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:53.280279    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:53.997925 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.997898    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="1dfb866412c437254cdbbaa67811d01947169b73af049c522bdde86e4082df37" exitCode=0
May 27 01:59:53.998375 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:53.997996    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"1dfb866412c437254cdbbaa67811d01947169b73af049c522bdde86e4082df37"}
May 27 01:59:54.842049 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:54.842014    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:54.842205 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:54.842021    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:54.842205 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:54.842142    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:54.842205 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:54.842196    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:56.842156 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:56.842127    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:56.842660 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:56.842132    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:56.842660 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:56.842241    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 01:59:56.842660 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:56.842330    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh7bl" podUID="f7eb2cd2-989f-48ca-9e66-b8501e782bc6"
May 27 01:59:57.481758 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.481727    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:57.481913 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.481877    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:57.481991 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.481938    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 02:00:29.481924144 +0000 UTC m=+66.277168552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 01:59:57.498159 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.498136    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeReady"
May 27 01:59:57.498287 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.498262    2547 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 01:59:57.560105 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.560074    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g7pt9"]
May 27 01:59:57.567138 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.567118    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-64q6v"]
May 27 01:59:57.567308 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.567290    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.570797 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.570773    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:57.571477 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.571459    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ngvd\""
May 27 01:59:57.571578 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.571516    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 01:59:57.571692 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.571588    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 01:59:57.573033 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.573011    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 01:59:57.573289 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.573270    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 01:59:57.573439 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.573418    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 01:59:57.573537 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.573477    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tmrqj\""
May 27 01:59:57.575594 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.575574    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64q6v"]
May 27 01:59:57.582743 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.582469    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7pt9"]
May 27 01:59:57.583878 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.583843    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:57.584599 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.584567    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 01:59:57.584599 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.584594    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 01:59:57.584599 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.584609    2547 projected.go:194] Error preparing data for projected volume kube-api-access-njlrx for pod openshift-network-diagnostics/network-check-target-dh7bl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:57.584802 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.584664    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx podName:f7eb2cd2-989f-48ca-9e66-b8501e782bc6 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:29.584646935 +0000 UTC m=+66.379891356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-njlrx" (UniqueName: "kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx") pod "network-check-target-dh7bl" (UID: "f7eb2cd2-989f-48ca-9e66-b8501e782bc6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 01:59:57.685724 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685684    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5751e0c-f5c3-4a46-b923-50fcc933aee6-tmp-dir\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.685874 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685734    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzwvp\" (UniqueName: \"kubernetes.io/projected/5af96246-6bcb-407a-9ff7-06df15433650-kube-api-access-mzwvp\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:57.685874 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685762    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9c98\" (UniqueName: \"kubernetes.io/projected/b5751e0c-f5c3-4a46-b923-50fcc933aee6-kube-api-access-g9c98\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.685874 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685804    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5751e0c-f5c3-4a46-b923-50fcc933aee6-config-volume\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.686048 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685884    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:57.686048 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.685909    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.787281 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787213    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:57.787281 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787248    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.787468 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787349    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5751e0c-f5c3-4a46-b923-50fcc933aee6-tmp-dir\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.787468 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.787379    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:57.787468 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.787450    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:58.287430907 +0000 UTC m=+35.082675316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 01:59:57.787468 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787384    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzwvp\" (UniqueName: \"kubernetes.io/projected/5af96246-6bcb-407a-9ff7-06df15433650-kube-api-access-mzwvp\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:57.787670 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.787469    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:57.787670 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787498    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9c98\" (UniqueName: \"kubernetes.io/projected/b5751e0c-f5c3-4a46-b923-50fcc933aee6-kube-api-access-g9c98\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.787670 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:57.787522    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:58.287506764 +0000 UTC m=+35.082751166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 01:59:57.787670 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787574    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5751e0c-f5c3-4a46-b923-50fcc933aee6-config-volume\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.787849 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.787716    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5751e0c-f5c3-4a46-b923-50fcc933aee6-tmp-dir\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.788034 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.788018    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5751e0c-f5c3-4a46-b923-50fcc933aee6-config-volume\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.797984 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.797943    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9c98\" (UniqueName: \"kubernetes.io/projected/b5751e0c-f5c3-4a46-b923-50fcc933aee6-kube-api-access-g9c98\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:57.798112 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:57.798088    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzwvp\" (UniqueName: \"kubernetes.io/projected/5af96246-6bcb-407a-9ff7-06df15433650-kube-api-access-mzwvp\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:58.291651 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.291613    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:58.292359 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.291674    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:58.292359 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:58.291732    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:58.292359 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:58.291808    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:59.291787587 +0000 UTC m=+36.087032010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 01:59:58.292359 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:58.291807    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:58.292359 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:58.291844    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 01:59:59.291837632 +0000 UTC m=+36.087082034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 01:59:58.842162 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.842127    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 01:59:58.842392 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.842371    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 01:59:58.846194 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.846168    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 01:59:58.846307 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.846190    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 01:59:58.846307 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.846241    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwv6g\""
May 27 01:59:58.846307 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.846180    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d6nl\""
May 27 01:59:58.846449 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:58.846359    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 01:59:59.298199 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:59.298180    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 01:59:59.298450 ip-10-0-128-250 kubenswrapper[2547]: I0527 01:59:59.298210    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 01:59:59.298450 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:59.298307    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 01:59:59.298450 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:59.298318    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 01:59:59.298450 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:59.298358    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.298346664 +0000 UTC m=+38.093591067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 01:59:59.298450 ip-10-0-128-250 kubenswrapper[2547]: E0527 01:59:59.298370    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:01.298364162 +0000 UTC m=+38.093608565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:00:00.011935 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:00.011902    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="e098eb63945a5cb1dd4ee3c4d5234b8bddf095c6ce86157f12f43803173a0565" exitCode=0
May 27 02:00:00.012054 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:00.011974    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"e098eb63945a5cb1dd4ee3c4d5234b8bddf095c6ce86157f12f43803173a0565"}
May 27 02:00:01.016233 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:01.016060    2547 generic.go:358] "Generic (PLEG): container finished" podID="756ca5d4-a51b-4367-a490-1bab1da5b262" containerID="be12cea3f966a8a45e1527e0ec8dcb7bd0f3da26d1eb705045228a6461b8b873" exitCode=0
May 27 02:00:01.016560 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:01.016134    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerDied","Data":"be12cea3f966a8a45e1527e0ec8dcb7bd0f3da26d1eb705045228a6461b8b873"}
May 27 02:00:01.312783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:01.312697    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:00:01.312783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:01.312727    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:00:01.312933 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:01.312821    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:01.312933 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:01.312822    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:01.312933 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:01.312864    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:05.312851857 +0000 UTC m=+42.108096259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 02:00:01.312933 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:01.312876    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:05.312870853 +0000 UTC m=+42.108115256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:00:02.021545 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:02.021506    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" event={"ID":"756ca5d4-a51b-4367-a490-1bab1da5b262","Type":"ContainerStarted","Data":"8cba62065d24ba53c765998260e230b3d23ded5fce5e928722ac6c6578099f5c"}
May 27 02:00:02.046637 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:02.046592    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2kwkw" podStartSLOduration=6.191834433 podStartE2EDuration="39.046578292s" podCreationTimestamp="2026-05-27 01:59:23 +0000 UTC" firstStartedPulling="2026-05-27 01:59:26.434555464 +0000 UTC m=+3.229799879" lastFinishedPulling="2026-05-27 01:59:59.289299321 +0000 UTC m=+36.084543738" observedRunningTime="2026-05-27 02:00:02.045064629 +0000 UTC m=+38.840309055" watchObservedRunningTime="2026-05-27 02:00:02.046578292 +0000 UTC m=+38.841822716"
May 27 02:00:05.342366 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:05.342327    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:00:05.342366 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:05.342365    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:00:05.342755 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:05.342481    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:05.342755 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:05.342537    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:05.342755 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:05.342546    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:13.342530612 +0000 UTC m=+50.137775015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:00:05.342755 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:05.342582    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:13.3425699 +0000 UTC m=+50.137814304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 02:00:13.394160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:13.394120    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:00:13.394160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:13.394156    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:00:13.394804 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:13.394278    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:13.394804 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:13.394340    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:29.394325728 +0000 UTC m=+66.189570131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 02:00:13.394804 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:13.394274    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:13.394804 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:13.394476    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:00:29.394454789 +0000 UTC m=+66.189699218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:00:25.010912 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:25.010885    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpn4x"
May 27 02:00:29.405106 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.405067    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:00:29.405106 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.405105    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:00:29.405541 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.405212    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:00:29.405541 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.405271    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:01.405255918 +0000 UTC m=+98.200500321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 02:00:29.405541 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.405212    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:00:29.405541 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.405352    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:01.405340723 +0000 UTC m=+98.200585131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:00:29.506126 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.506099    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:00:29.508860 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.508844    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 02:00:29.516924 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.516909    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 02:00:29.516990 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:00:29.516983    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 02:01:33.516952339 +0000 UTC m=+130.312196742 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : secret "metrics-daemon-secret" not found
May 27 02:00:29.606565 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.606537    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 02:00:29.609201 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.609184    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 02:00:29.619683 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.619666    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 02:00:29.630723 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.630703    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njlrx\" (UniqueName: \"kubernetes.io/projected/f7eb2cd2-989f-48ca-9e66-b8501e782bc6-kube-api-access-njlrx\") pod \"network-check-target-dh7bl\" (UID: \"f7eb2cd2-989f-48ca-9e66-b8501e782bc6\") " pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 02:00:29.755721 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.755698    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwv6g\""
May 27 02:00:29.763892 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.763874    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 02:00:29.889287 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:29.889258    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dh7bl"]
May 27 02:00:29.892134 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:00:29.892105    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7eb2cd2_989f_48ca_9e66_b8501e782bc6.slice/crio-5f2c5fd05ef811d5a296b87d51a568a637bb07cbf6cbf1a0673474210ae238d8 WatchSource:0}: Error finding container 5f2c5fd05ef811d5a296b87d51a568a637bb07cbf6cbf1a0673474210ae238d8: Status 404 returned error can't find the container with id 5f2c5fd05ef811d5a296b87d51a568a637bb07cbf6cbf1a0673474210ae238d8
May 27 02:00:30.073221 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:30.073164    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dh7bl" event={"ID":"f7eb2cd2-989f-48ca-9e66-b8501e782bc6","Type":"ContainerStarted","Data":"5f2c5fd05ef811d5a296b87d51a568a637bb07cbf6cbf1a0673474210ae238d8"}
May 27 02:00:33.080059 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:33.080027    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dh7bl" event={"ID":"f7eb2cd2-989f-48ca-9e66-b8501e782bc6","Type":"ContainerStarted","Data":"a0dad9e0b909e6091161dfd0faf171db2db09bd88abe51e4c734d6e6c73669c9"}
May 27 02:00:33.080457 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:33.080160    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 02:00:33.098090 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:00:33.098043    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dh7bl" podStartSLOduration=67.453247483 podStartE2EDuration="1m10.098029255s" podCreationTimestamp="2026-05-27 01:59:23 +0000 UTC" firstStartedPulling="2026-05-27 02:00:29.893776763 +0000 UTC m=+66.689021165" lastFinishedPulling="2026-05-27 02:00:32.53855852 +0000 UTC m=+69.333802937" observedRunningTime="2026-05-27 02:00:33.097472909 +0000 UTC m=+69.892717334" watchObservedRunningTime="2026-05-27 02:00:33.098029255 +0000 UTC m=+69.893273745"
May 27 02:01:01.506050 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:01.506015    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:01:01.506050 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:01.506051    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:01:01.506557 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:01.506142    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 02:01:01.506557 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:01.506153    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 02:01:01.506557 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:01.506194    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls podName:b5751e0c-f5c3-4a46-b923-50fcc933aee6 nodeName:}" failed. No retries permitted until 2026-05-27 02:02:05.506181034 +0000 UTC m=+162.301425437 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls") pod "dns-default-g7pt9" (UID: "b5751e0c-f5c3-4a46-b923-50fcc933aee6") : secret "dns-default-metrics-tls" not found
May 27 02:01:01.506557 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:01.506217    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert podName:5af96246-6bcb-407a-9ff7-06df15433650 nodeName:}" failed. No retries permitted until 2026-05-27 02:02:05.506203657 +0000 UTC m=+162.301448060 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert") pod "ingress-canary-64q6v" (UID: "5af96246-6bcb-407a-9ff7-06df15433650") : secret "canary-serving-cert" not found
May 27 02:01:04.083997 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:04.083939    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dh7bl"
May 27 02:01:25.262622 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.262581    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vjvz5"]
May 27 02:01:25.266102 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.266079    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.268233 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.268203    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"]
May 27 02:01:25.268754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.268729    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 27 02:01:25.268847 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.268769    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 27 02:01:25.269262 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.269246    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n5746\""
May 27 02:01:25.270448 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.270432    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"]
May 27 02:01:25.270573 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.270558    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"
May 27 02:01:25.271398 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.271380    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 27 02:01:25.272666 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.272646    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 27 02:01:25.272901 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.272885    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.274720 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.274700    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 27 02:01:25.275526 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.275470    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xfb49\""
May 27 02:01:25.276498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.275890    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 27 02:01:25.276498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.276120    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 27 02:01:25.276498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.276457    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 27 02:01:25.277007 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.276735    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 27 02:01:25.277007 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.276888    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7s9pl\""
May 27 02:01:25.279802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.279747    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 27 02:01:25.280441 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.280417    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vjvz5"]
May 27 02:01:25.287403 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.287381    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"]
May 27 02:01:25.307621 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.307602    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"]
May 27 02:01:25.355625 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355602    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-config\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.355721 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355635    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbxd\" (UniqueName: \"kubernetes.io/projected/d0946cc3-5359-4f27-981a-8efaf993f676-kube-api-access-ppbxd\") pod \"volume-data-source-validator-5cf8c89d64-w6fc9\" (UID: \"d0946cc3-5359-4f27-981a-8efaf993f676\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"
May 27 02:01:25.355721 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355655    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c06ce271-5849-45a8-a50d-8d4b0ec198b5-serving-cert\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.355721 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-trusted-ca\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.355721 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355708    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrx4\" (UniqueName: \"kubernetes.io/projected/d5756c2c-f2e1-464a-b593-bc6729d5954f-kube-api-access-lqrx4\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.355848 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vqq\" (UniqueName: \"kubernetes.io/projected/c06ce271-5849-45a8-a50d-8d4b0ec198b5-kube-api-access-s6vqq\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.355888 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.355852    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.362493 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.362472    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"]
May 27 02:01:25.364985 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.364949    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"
May 27 02:01:25.369286 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.369269    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t749j\""
May 27 02:01:25.378220 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.378202    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:01:25.380482 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.380468    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-x2d48"]
May 27 02:01:25.380610 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.380595    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.382855 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.382841    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.385138 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.385121    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 02:01:25.387342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.387321    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 27 02:01:25.387436 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.387339    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 02:01:25.387497 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.387469    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 02:01:25.387677 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.387661    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dhnh5\""
May 27 02:01:25.387746 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.387701    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 27 02:01:25.388052 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.388037    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x7747\""
May 27 02:01:25.388207 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.388189    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 02:01:25.394595 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.394579    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 02:01:25.396215 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.396193    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 27 02:01:25.397277 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.397258    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"]
May 27 02:01:25.397828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.397808    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 02:01:25.418012 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.417989    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:01:25.418997 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.418981    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-x2d48"]
May 27 02:01:25.456783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456750    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c06ce271-5849-45a8-a50d-8d4b0ec198b5-serving-cert\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.456783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456782    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-trusted-ca\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456805    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrx4\" (UniqueName: \"kubernetes.io/projected/d5756c2c-f2e1-464a-b593-bc6729d5954f-kube-api-access-lqrx4\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456836    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456887    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vqq\" (UniqueName: \"kubernetes.io/projected/c06ce271-5849-45a8-a50d-8d4b0ec198b5-kube-api-access-s6vqq\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456915    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kv7\" (UniqueName: \"kubernetes.io/projected/fdbecc2b-8cdd-4daf-8845-f023c82dc567-kube-api-access-x8kv7\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456944    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.456985    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457015    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457102    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-service-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.457127    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457125    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbecc2b-8cdd-4daf-8845-f023c82dc567-serving-cert\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.457209    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls podName:d5756c2c-f2e1-464a-b593-bc6729d5954f nodeName:}" failed. No retries permitted until 2026-05-27 02:01:25.957187329 +0000 UTC m=+122.752431735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls") pod "cluster-samples-operator-697587599-7vglg" (UID: "d5756c2c-f2e1-464a-b593-bc6729d5954f") : secret "samples-operator-tls" not found
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457263    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-config\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457282    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-tmp\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25f5l\" (UniqueName: \"kubernetes.io/projected/247829da-939d-4ff1-b39e-5ea71f79003d-kube-api-access-25f5l\") pod \"network-check-source-7f44b6dd87-lkv8h\" (UID: \"247829da-939d-4ff1-b39e-5ea71f79003d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457390    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-snapshots\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457419    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdbp\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457444    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbxd\" (UniqueName: \"kubernetes.io/projected/d0946cc3-5359-4f27-981a-8efaf993f676-kube-api-access-ppbxd\") pod \"volume-data-source-validator-5cf8c89d64-w6fc9\" (UID: \"d0946cc3-5359-4f27-981a-8efaf993f676\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"
May 27 02:01:25.457528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457478    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.458047 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457557    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.458047 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457800    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-config\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.458047 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.457825    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c06ce271-5849-45a8-a50d-8d4b0ec198b5-trusted-ca\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.459331 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.459312    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c06ce271-5849-45a8-a50d-8d4b0ec198b5-serving-cert\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.468222 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.468192    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrx4\" (UniqueName: \"kubernetes.io/projected/d5756c2c-f2e1-464a-b593-bc6729d5954f-kube-api-access-lqrx4\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.469400 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.469378    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbxd\" (UniqueName: \"kubernetes.io/projected/d0946cc3-5359-4f27-981a-8efaf993f676-kube-api-access-ppbxd\") pod \"volume-data-source-validator-5cf8c89d64-w6fc9\" (UID: \"d0946cc3-5359-4f27-981a-8efaf993f676\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"
May 27 02:01:25.469760 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.469735    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vqq\" (UniqueName: \"kubernetes.io/projected/c06ce271-5849-45a8-a50d-8d4b0ec198b5-kube-api-access-s6vqq\") pod \"console-operator-76dff48d59-vjvz5\" (UID: \"c06ce271-5849-45a8-a50d-8d4b0ec198b5\") " pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.561857 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.561754    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.562158 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562141    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562228 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562173    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-service-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.562228 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562201    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbecc2b-8cdd-4daf-8845-f023c82dc567-serving-cert\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.562300 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562244    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-tmp\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.562300 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562268    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25f5l\" (UniqueName: \"kubernetes.io/projected/247829da-939d-4ff1-b39e-5ea71f79003d-kube-api-access-25f5l\") pod \"network-check-source-7f44b6dd87-lkv8h\" (UID: \"247829da-939d-4ff1-b39e-5ea71f79003d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"
May 27 02:01:25.562300 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562295    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562437 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562323    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-snapshots\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.562437 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562345    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdbp\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562437 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562373    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562437 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562397    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562606 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562438    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.562916 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.562758    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 02:01:25.562916 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.562783    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57799b9bc4-zxbg8: secret "image-registry-tls" not found
May 27 02:01:25.562916 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.562853    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls podName:20bfee18-fa86-4a7c-9ef4-10536eb4af35 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:26.06283233 +0000 UTC m=+122.858076741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls") pod "image-registry-57799b9bc4-zxbg8" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35") : secret "image-registry-tls" not found
May 27 02:01:25.562916 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562896    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-tmp\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.563206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.562953    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.563206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563037    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kv7\" (UniqueName: \"kubernetes.io/projected/fdbecc2b-8cdd-4daf-8845-f023c82dc567-kube-api-access-x8kv7\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.563206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563075    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.563206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563106    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.563572 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563550    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.563643 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563620    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.563817 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563794    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-service-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.563891 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563827    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbecc2b-8cdd-4daf-8845-f023c82dc567-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.563891 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.563853    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fdbecc2b-8cdd-4daf-8845-f023c82dc567-snapshots\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.564929 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.564903    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.565034 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.564937    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbecc2b-8cdd-4daf-8845-f023c82dc567-serving-cert\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.565264 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.565246    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.575585 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.575564    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.575681 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.575629    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdbp\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:25.575831 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.575808    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25f5l\" (UniqueName: \"kubernetes.io/projected/247829da-939d-4ff1-b39e-5ea71f79003d-kube-api-access-25f5l\") pod \"network-check-source-7f44b6dd87-lkv8h\" (UID: \"247829da-939d-4ff1-b39e-5ea71f79003d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"
May 27 02:01:25.576356 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.576340    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kv7\" (UniqueName: \"kubernetes.io/projected/fdbecc2b-8cdd-4daf-8845-f023c82dc567-kube-api-access-x8kv7\") pod \"insights-operator-78bdfb888c-x2d48\" (UID: \"fdbecc2b-8cdd-4daf-8845-f023c82dc567\") " pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.578202 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.578188    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:25.584783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.584767    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"
May 27 02:01:25.672487 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.672457    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"
May 27 02:01:25.694887 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.694729    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-x2d48"
May 27 02:01:25.704784 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.704753    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-vjvz5"]
May 27 02:01:25.707984 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:25.707946    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06ce271_5849_45a8_a50d_8d4b0ec198b5.slice/crio-05e23dd1741c262e68191f53b9a23c6b28f9333b2bc6ad1a68dbb0d1c235f614 WatchSource:0}: Error finding container 05e23dd1741c262e68191f53b9a23c6b28f9333b2bc6ad1a68dbb0d1c235f614: Status 404 returned error can't find the container with id 05e23dd1741c262e68191f53b9a23c6b28f9333b2bc6ad1a68dbb0d1c235f614
May 27 02:01:25.721557 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.721532    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9"]
May 27 02:01:25.722996 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:25.722953    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0946cc3_5359_4f27_981a_8efaf993f676.slice/crio-f03d135b54047bda95ae8d18f5dfae62c49b450ddd681c2dc3f6921198a1e0c7 WatchSource:0}: Error finding container f03d135b54047bda95ae8d18f5dfae62c49b450ddd681c2dc3f6921198a1e0c7: Status 404 returned error can't find the container with id f03d135b54047bda95ae8d18f5dfae62c49b450ddd681c2dc3f6921198a1e0c7
May 27 02:01:25.809051 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.809016    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h"]
May 27 02:01:25.813457 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:25.813398    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247829da_939d_4ff1_b39e_5ea71f79003d.slice/crio-c14fbf0469f8fb9633fb82527c9c7cb394d3b6535ce6e1c39bda362d2abad586 WatchSource:0}: Error finding container c14fbf0469f8fb9633fb82527c9c7cb394d3b6535ce6e1c39bda362d2abad586: Status 404 returned error can't find the container with id c14fbf0469f8fb9633fb82527c9c7cb394d3b6535ce6e1c39bda362d2abad586
May 27 02:01:25.822245 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.822222    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-x2d48"]
May 27 02:01:25.824707 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:25.824684    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbecc2b_8cdd_4daf_8845_f023c82dc567.slice/crio-48c54562f20b6f040136c198779b4e245249f7494d44d1d8a8afeea40c840d6c WatchSource:0}: Error finding container 48c54562f20b6f040136c198779b4e245249f7494d44d1d8a8afeea40c840d6c: Status 404 returned error can't find the container with id 48c54562f20b6f040136c198779b4e245249f7494d44d1d8a8afeea40c840d6c
May 27 02:01:25.967561 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:25.967531    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:25.967693 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.967673    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 02:01:25.967751 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:25.967723    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls podName:d5756c2c-f2e1-464a-b593-bc6729d5954f nodeName:}" failed. No retries permitted until 2026-05-27 02:01:26.967709786 +0000 UTC m=+123.762954194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls") pod "cluster-samples-operator-697587599-7vglg" (UID: "d5756c2c-f2e1-464a-b593-bc6729d5954f") : secret "samples-operator-tls" not found
May 27 02:01:26.068324 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.068249    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:26.068436 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:26.068387    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 02:01:26.068436 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:26.068405    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57799b9bc4-zxbg8: secret "image-registry-tls" not found
May 27 02:01:26.068535 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:26.068448    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls podName:20bfee18-fa86-4a7c-9ef4-10536eb4af35 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:27.068435588 +0000 UTC m=+123.863679990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls") pod "image-registry-57799b9bc4-zxbg8" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35") : secret "image-registry-tls" not found
May 27 02:01:26.175012 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.174986    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-x2d48" event={"ID":"fdbecc2b-8cdd-4daf-8845-f023c82dc567","Type":"ContainerStarted","Data":"48c54562f20b6f040136c198779b4e245249f7494d44d1d8a8afeea40c840d6c"}
May 27 02:01:26.176566 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.176544    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h" event={"ID":"247829da-939d-4ff1-b39e-5ea71f79003d","Type":"ContainerStarted","Data":"8ec48951db94cec5dcb09191228529b5d36bca61380c5be8616d951ced68482d"}
May 27 02:01:26.176659 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.176573    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h" event={"ID":"247829da-939d-4ff1-b39e-5ea71f79003d","Type":"ContainerStarted","Data":"c14fbf0469f8fb9633fb82527c9c7cb394d3b6535ce6e1c39bda362d2abad586"}
May 27 02:01:26.177476 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.177448    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9" event={"ID":"d0946cc3-5359-4f27-981a-8efaf993f676","Type":"ContainerStarted","Data":"f03d135b54047bda95ae8d18f5dfae62c49b450ddd681c2dc3f6921198a1e0c7"}
May 27 02:01:26.178393 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.178374    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" event={"ID":"c06ce271-5849-45a8-a50d-8d4b0ec198b5","Type":"ContainerStarted","Data":"05e23dd1741c262e68191f53b9a23c6b28f9333b2bc6ad1a68dbb0d1c235f614"}
May 27 02:01:26.191167 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.191127    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lkv8h" podStartSLOduration=1.191116039 podStartE2EDuration="1.191116039s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:01:26.190534271 +0000 UTC m=+122.985778696" watchObservedRunningTime="2026-05-27 02:01:26.191116039 +0000 UTC m=+122.986360464"
May 27 02:01:26.976327 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:26.976267    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:26.976796 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:26.976404    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 02:01:26.976796 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:26.976486    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls podName:d5756c2c-f2e1-464a-b593-bc6729d5954f nodeName:}" failed. No retries permitted until 2026-05-27 02:01:28.976465731 +0000 UTC m=+125.771710139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls") pod "cluster-samples-operator-697587599-7vglg" (UID: "d5756c2c-f2e1-464a-b593-bc6729d5954f") : secret "samples-operator-tls" not found
May 27 02:01:27.076853 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:27.076815    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:27.077084 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:27.077059    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 02:01:27.077084 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:27.077076    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57799b9bc4-zxbg8: secret "image-registry-tls" not found
May 27 02:01:27.077214 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:27.077131    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls podName:20bfee18-fa86-4a7c-9ef4-10536eb4af35 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:29.077112961 +0000 UTC m=+125.872357381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls") pod "image-registry-57799b9bc4-zxbg8" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35") : secret "image-registry-tls" not found
May 27 02:01:28.991843 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:28.991813    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:28.992262 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:28.992033    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 02:01:28.992262 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:28.992118    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls podName:d5756c2c-f2e1-464a-b593-bc6729d5954f nodeName:}" failed. No retries permitted until 2026-05-27 02:01:32.992096521 +0000 UTC m=+129.787340929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls") pod "cluster-samples-operator-697587599-7vglg" (UID: "d5756c2c-f2e1-464a-b593-bc6729d5954f") : secret "samples-operator-tls" not found
May 27 02:01:29.092622 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.092593    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:29.092731 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:29.092706    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 02:01:29.092731 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:29.092721    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57799b9bc4-zxbg8: secret "image-registry-tls" not found
May 27 02:01:29.092806 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:29.092761    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls podName:20bfee18-fa86-4a7c-9ef4-10536eb4af35 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:33.092749653 +0000 UTC m=+129.887994058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls") pod "image-registry-57799b9bc4-zxbg8" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35") : secret "image-registry-tls" not found
May 27 02:01:29.186997 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.186955    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-x2d48" event={"ID":"fdbecc2b-8cdd-4daf-8845-f023c82dc567","Type":"ContainerStarted","Data":"f87c873e76817cecff539fdafb27c656bc49d1d7c251c891d0c2c448e7faf050"}
May 27 02:01:29.188268 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.188245    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9" event={"ID":"d0946cc3-5359-4f27-981a-8efaf993f676","Type":"ContainerStarted","Data":"902769a273360b14a4ff2625b25c3bf014118f6d9d77dc9d87c6ca62613cb999"}
May 27 02:01:29.189576 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.189556    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/0.log"
May 27 02:01:29.189656 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.189595    2547 generic.go:358] "Generic (PLEG): container finished" podID="c06ce271-5849-45a8-a50d-8d4b0ec198b5" containerID="900d354a6436c0458612108e1bb4347152049b7cb7bea12ce0cdec997fe8c667" exitCode=255
May 27 02:01:29.189656 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.189624    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" event={"ID":"c06ce271-5849-45a8-a50d-8d4b0ec198b5","Type":"ContainerDied","Data":"900d354a6436c0458612108e1bb4347152049b7cb7bea12ce0cdec997fe8c667"}
May 27 02:01:29.189884 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.189867    2547 scope.go:117] "RemoveContainer" containerID="900d354a6436c0458612108e1bb4347152049b7cb7bea12ce0cdec997fe8c667"
May 27 02:01:29.206308 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.206272    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-x2d48" podStartSLOduration=1.641151726 podStartE2EDuration="4.206261748s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:25.82840094 +0000 UTC m=+122.623645343" lastFinishedPulling="2026-05-27 02:01:28.393510949 +0000 UTC m=+125.188755365" observedRunningTime="2026-05-27 02:01:29.205363856 +0000 UTC m=+126.000608282" watchObservedRunningTime="2026-05-27 02:01:29.206261748 +0000 UTC m=+126.001506220"
May 27 02:01:29.242838 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.242766    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w6fc9" podStartSLOduration=1.580088312 podStartE2EDuration="4.24275036s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:25.725285613 +0000 UTC m=+122.520530018" lastFinishedPulling="2026-05-27 02:01:28.387947656 +0000 UTC m=+125.183192066" observedRunningTime="2026-05-27 02:01:29.242545256 +0000 UTC m=+126.037789681" watchObservedRunningTime="2026-05-27 02:01:29.24275036 +0000 UTC m=+126.037994786"
May 27 02:01:29.835811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.835781    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"]
May 27 02:01:29.838778 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.838762    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"
May 27 02:01:29.841603 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.841574    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 27 02:01:29.841727 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.841579    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 27 02:01:29.841727 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.841640    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9r9k8\""
May 27 02:01:29.855219 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.855192    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"]
May 27 02:01:29.899026 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.899003    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngrs\" (UniqueName: \"kubernetes.io/projected/55a391f3-cb81-4beb-bcc3-324bf1f1ea46-kube-api-access-lngrs\") pod \"migrator-b985f5d89-lfmzh\" (UID: \"55a391f3-cb81-4beb-bcc3-324bf1f1ea46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"
May 27 02:01:29.999505 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:29.999481    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lngrs\" (UniqueName: \"kubernetes.io/projected/55a391f3-cb81-4beb-bcc3-324bf1f1ea46-kube-api-access-lngrs\") pod \"migrator-b985f5d89-lfmzh\" (UID: \"55a391f3-cb81-4beb-bcc3-324bf1f1ea46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"
May 27 02:01:30.007672 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.007651    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngrs\" (UniqueName: \"kubernetes.io/projected/55a391f3-cb81-4beb-bcc3-324bf1f1ea46-kube-api-access-lngrs\") pod \"migrator-b985f5d89-lfmzh\" (UID: \"55a391f3-cb81-4beb-bcc3-324bf1f1ea46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"
May 27 02:01:30.147466 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.147414    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"
May 27 02:01:30.195383 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.195360    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/1.log"
May 27 02:01:30.195851 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.195831    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/0.log"
May 27 02:01:30.195951 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.195872    2547 generic.go:358] "Generic (PLEG): container finished" podID="c06ce271-5849-45a8-a50d-8d4b0ec198b5" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e" exitCode=255
May 27 02:01:30.196197 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.196168    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" event={"ID":"c06ce271-5849-45a8-a50d-8d4b0ec198b5","Type":"ContainerDied","Data":"1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"}
May 27 02:01:30.196315 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.196219    2547 scope.go:117] "RemoveContainer" containerID="900d354a6436c0458612108e1bb4347152049b7cb7bea12ce0cdec997fe8c667"
May 27 02:01:30.196780 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.196432    2547 scope.go:117] "RemoveContainer" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"
May 27 02:01:30.196780 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:30.196643    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:01:30.274808 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:30.274779    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh"]
May 27 02:01:30.278250 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:30.278226    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a391f3_cb81_4beb_bcc3_324bf1f1ea46.slice/crio-4f27b5d2be3aece6b5ed218c808b1e7f7e7b38c01244579315c73c3044e5ed21 WatchSource:0}: Error finding container 4f27b5d2be3aece6b5ed218c808b1e7f7e7b38c01244579315c73c3044e5ed21: Status 404 returned error can't find the container with id 4f27b5d2be3aece6b5ed218c808b1e7f7e7b38c01244579315c73c3044e5ed21
May 27 02:01:31.151565 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:31.151535    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g2jbf_9914aa31-1af5-4a64-bb0b-8672c0df9c87/dns-node-resolver/0.log"
May 27 02:01:31.199571 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:31.199542    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/1.log"
May 27 02:01:31.199994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:31.199951    2547 scope.go:117] "RemoveContainer" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"
May 27 02:01:31.200209 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:31.200186    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:01:31.200782 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:31.200757    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh" event={"ID":"55a391f3-cb81-4beb-bcc3-324bf1f1ea46","Type":"ContainerStarted","Data":"4f27b5d2be3aece6b5ed218c808b1e7f7e7b38c01244579315c73c3044e5ed21"}
May 27 02:01:32.152607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:32.152548    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xgxh_8ee79504-aff2-4ce6-b49a-fb19ddef6875/node-ca/0.log"
May 27 02:01:32.206619 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:32.206575    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh" event={"ID":"55a391f3-cb81-4beb-bcc3-324bf1f1ea46","Type":"ContainerStarted","Data":"ecc63dba31cf5ffee611d85ac2e2e4137696a962740d746b7ea83ae1600b494f"}
May 27 02:01:32.206619 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:32.206607    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh" event={"ID":"55a391f3-cb81-4beb-bcc3-324bf1f1ea46","Type":"ContainerStarted","Data":"9dd5a25a5e36a155cc8ccfe313b98b52e0e60a881aa94fe0b51dfb9cec99cfdc"}
May 27 02:01:32.223776 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:32.223659    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lfmzh" podStartSLOduration=1.76349066 podStartE2EDuration="3.223643431s" podCreationTimestamp="2026-05-27 02:01:29 +0000 UTC" firstStartedPulling="2026-05-27 02:01:30.28003533 +0000 UTC m=+127.075279733" lastFinishedPulling="2026-05-27 02:01:31.740188091 +0000 UTC m=+128.535432504" observedRunningTime="2026-05-27 02:01:32.223427098 +0000 UTC m=+129.018671522" watchObservedRunningTime="2026-05-27 02:01:32.223643431 +0000 UTC m=+129.018887856"
May 27 02:01:33.022262 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:33.022234    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:33.022461 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.022385    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 27 02:01:33.022461 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.022447    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls podName:d5756c2c-f2e1-464a-b593-bc6729d5954f nodeName:}" failed. No retries permitted until 2026-05-27 02:01:41.022432675 +0000 UTC m=+137.817677078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls") pod "cluster-samples-operator-697587599-7vglg" (UID: "d5756c2c-f2e1-464a-b593-bc6729d5954f") : secret "samples-operator-tls" not found
May 27 02:01:33.122847 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:33.122818    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:33.122996 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.122929    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 02:01:33.122996 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.122944    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57799b9bc4-zxbg8: secret "image-registry-tls" not found
May 27 02:01:33.123081 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.123004    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls podName:20bfee18-fa86-4a7c-9ef4-10536eb4af35 nodeName:}" failed. No retries permitted until 2026-05-27 02:01:41.122992902 +0000 UTC m=+137.918237305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls") pod "image-registry-57799b9bc4-zxbg8" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35") : secret "image-registry-tls" not found
May 27 02:01:33.525110 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:33.525085    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:01:33.525437 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.525172    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 02:01:33.525437 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:33.525216    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs podName:7a970a1a-c99e-4f0d-a29c-8d6e82e1387b nodeName:}" failed. No retries permitted until 2026-05-27 02:03:35.525204394 +0000 UTC m=+252.320448801 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs") pod "network-metrics-daemon-59jjz" (UID: "7a970a1a-c99e-4f0d-a29c-8d6e82e1387b") : secret "metrics-daemon-secret" not found
May 27 02:01:35.578602 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:35.578569    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:35.578602 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:35.578599    2547 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:35.579017 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:35.578910    2547 scope.go:117] "RemoveContainer" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"
May 27 02:01:35.579103 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:35.579085    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:01:41.078473 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.078439    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:41.080747 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.080728    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5756c2c-f2e1-464a-b593-bc6729d5954f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7vglg\" (UID: \"d5756c2c-f2e1-464a-b593-bc6729d5954f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:41.179337 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.179315    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:41.181515 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.181487    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"image-registry-57799b9bc4-zxbg8\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") " pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:41.190843 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.190824    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"
May 27 02:01:41.291006 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.290980    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:41.306059 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.306035    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg"]
May 27 02:01:41.433461 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:41.433435    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:01:41.435894 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:41.435869    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bfee18_fa86_4a7c_9ef4_10536eb4af35.slice/crio-6d98bc5c9b7aea97c949e63bb1756005c26fdcc72c3441238574f5ea27a4c60d WatchSource:0}: Error finding container 6d98bc5c9b7aea97c949e63bb1756005c26fdcc72c3441238574f5ea27a4c60d: Status 404 returned error can't find the container with id 6d98bc5c9b7aea97c949e63bb1756005c26fdcc72c3441238574f5ea27a4c60d
May 27 02:01:42.230580 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:42.230544    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" event={"ID":"20bfee18-fa86-4a7c-9ef4-10536eb4af35","Type":"ContainerStarted","Data":"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"}
May 27 02:01:42.230987 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:42.230584    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" event={"ID":"20bfee18-fa86-4a7c-9ef4-10536eb4af35","Type":"ContainerStarted","Data":"6d98bc5c9b7aea97c949e63bb1756005c26fdcc72c3441238574f5ea27a4c60d"}
May 27 02:01:42.230987 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:42.230677    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:01:42.231549 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:42.231530    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg" event={"ID":"d5756c2c-f2e1-464a-b593-bc6729d5954f","Type":"ContainerStarted","Data":"f53804eb32cf31c0595596e92a27ae3c312c3ab58c7252175010e656b1a536df"}
May 27 02:01:42.250365 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:42.250329    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" podStartSLOduration=17.250319209 podStartE2EDuration="17.250319209s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:01:42.249041778 +0000 UTC m=+139.044286203" watchObservedRunningTime="2026-05-27 02:01:42.250319209 +0000 UTC m=+139.045563633"
May 27 02:01:44.237597 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:44.237566    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg" event={"ID":"d5756c2c-f2e1-464a-b593-bc6729d5954f","Type":"ContainerStarted","Data":"956798c203723b22b07f0d5af730dff575afc29d9ea51c574fc4e9a73385de1d"}
May 27 02:01:44.237597 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:44.237600    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg" event={"ID":"d5756c2c-f2e1-464a-b593-bc6729d5954f","Type":"ContainerStarted","Data":"f399b87a426690aa7176e91ed524e94daf2ef053165d7c2deecbbe9dd6238c91"}
May 27 02:01:44.255340 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:44.255292    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7vglg" podStartSLOduration=17.042373658 podStartE2EDuration="19.255277931s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:41.372249999 +0000 UTC m=+138.167494402" lastFinishedPulling="2026-05-27 02:01:43.585154269 +0000 UTC m=+140.380398675" observedRunningTime="2026-05-27 02:01:44.255193914 +0000 UTC m=+141.050438340" watchObservedRunningTime="2026-05-27 02:01:44.255277931 +0000 UTC m=+141.050522358"
May 27 02:01:50.841607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:50.841574    2547 scope.go:117] "RemoveContainer" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"
May 27 02:01:51.256108 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256086    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:01:51.256441 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256424    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/1.log"
May 27 02:01:51.256540 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256464    2547 generic.go:358] "Generic (PLEG): container finished" podID="c06ce271-5849-45a8-a50d-8d4b0ec198b5" containerID="7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2" exitCode=255
May 27 02:01:51.256582 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256545    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" event={"ID":"c06ce271-5849-45a8-a50d-8d4b0ec198b5","Type":"ContainerDied","Data":"7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2"}
May 27 02:01:51.256623 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256594    2547 scope.go:117] "RemoveContainer" containerID="1fdaea8e41f2a87ba15c2abf7e3e074934ed1dda66ae495368cba4b075de981e"
May 27 02:01:51.256911 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:51.256885    2547 scope.go:117] "RemoveContainer" containerID="7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2"
May 27 02:01:51.257143 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:51.257125    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:01:52.259725 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:52.259701    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:01:55.537447 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.537412    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:01:55.552109 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.552083    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shbxx"]
May 27 02:01:55.558034 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.558014    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.560600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.560583    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 02:01:55.560600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.560591    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62mqj\""
May 27 02:01:55.560730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.560690    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 02:01:55.564764 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.564742    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shbxx"]
May 27 02:01:55.578800 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.578734    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:55.578800 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.578758    2547 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:01:55.579059 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.579046    2547 scope.go:117] "RemoveContainer" containerID="7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2"
May 27 02:01:55.579204 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:01:55.579188    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:01:55.673612 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.673588    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89da5e65-1b3b-4889-b4a4-3538b48cbebf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.673724 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.673621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89da5e65-1b3b-4889-b4a4-3538b48cbebf-crio-socket\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.673724 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.673680    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.673853 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.673776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89da5e65-1b3b-4889-b4a4-3538b48cbebf-data-volume\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.673853 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.673831    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqqxg\" (UniqueName: \"kubernetes.io/projected/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-api-access-tqqxg\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774719 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774696    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89da5e65-1b3b-4889-b4a4-3538b48cbebf-crio-socket\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774727    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774749    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89da5e65-1b3b-4889-b4a4-3538b48cbebf-data-volume\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774768    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqqxg\" (UniqueName: \"kubernetes.io/projected/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-api-access-tqqxg\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774912 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774809    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89da5e65-1b3b-4889-b4a4-3538b48cbebf-crio-socket\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.774912 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.774895    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89da5e65-1b3b-4889-b4a4-3538b48cbebf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.775156 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.775135    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89da5e65-1b3b-4889-b4a4-3538b48cbebf-data-volume\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.775260 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.775243    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.776999 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.776983    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89da5e65-1b3b-4889-b4a4-3538b48cbebf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.785348 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.785326    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqqxg\" (UniqueName: \"kubernetes.io/projected/89da5e65-1b3b-4889-b4a4-3538b48cbebf-kube-api-access-tqqxg\") pod \"insights-runtime-extractor-shbxx\" (UID: \"89da5e65-1b3b-4889-b4a4-3538b48cbebf\") " pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.867076 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.867028    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shbxx"
May 27 02:01:55.987549 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:55.987518    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shbxx"]
May 27 02:01:55.990943 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:01:55.990911    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89da5e65_1b3b_4889_b4a4_3538b48cbebf.slice/crio-ca03ffe6fa35781c32496b6d7341b536f10e64e2ae5431210ecad14702dfd06b WatchSource:0}: Error finding container ca03ffe6fa35781c32496b6d7341b536f10e64e2ae5431210ecad14702dfd06b: Status 404 returned error can't find the container with id ca03ffe6fa35781c32496b6d7341b536f10e64e2ae5431210ecad14702dfd06b
May 27 02:01:56.271433 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:56.271402    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shbxx" event={"ID":"89da5e65-1b3b-4889-b4a4-3538b48cbebf","Type":"ContainerStarted","Data":"2f7ae0f16fd5a221df4a2748206d2bc89fd45e593329f688d2f43b528044d285"}
May 27 02:01:56.271433 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:56.271440    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shbxx" event={"ID":"89da5e65-1b3b-4889-b4a4-3538b48cbebf","Type":"ContainerStarted","Data":"ca03ffe6fa35781c32496b6d7341b536f10e64e2ae5431210ecad14702dfd06b"}
May 27 02:01:57.274601 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:57.274572    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shbxx" event={"ID":"89da5e65-1b3b-4889-b4a4-3538b48cbebf","Type":"ContainerStarted","Data":"e6369ae339d670fc77a67979b1edc20ffb81f3c6a5323fd0bfdd67c1da98403d"}
May 27 02:01:59.283348 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:59.283313    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shbxx" event={"ID":"89da5e65-1b3b-4889-b4a4-3538b48cbebf","Type":"ContainerStarted","Data":"5850fd28da8f34dbc08603dfc3d278262b3f70258f99580001acffec52173708"}
May 27 02:01:59.301767 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:01:59.301706    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shbxx" podStartSLOduration=1.745754646 podStartE2EDuration="4.30169286s" podCreationTimestamp="2026-05-27 02:01:55 +0000 UTC" firstStartedPulling="2026-05-27 02:01:56.047237345 +0000 UTC m=+152.842481748" lastFinishedPulling="2026-05-27 02:01:58.603175558 +0000 UTC m=+155.398419962" observedRunningTime="2026-05-27 02:01:59.299905854 +0000 UTC m=+156.095150280" watchObservedRunningTime="2026-05-27 02:01:59.30169286 +0000 UTC m=+156.096937285"
May 27 02:02:00.586642 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:00.586586    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g7pt9" podUID="b5751e0c-f5c3-4a46-b923-50fcc933aee6"
May 27 02:02:00.590760 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:00.590731    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-64q6v" podUID="5af96246-6bcb-407a-9ff7-06df15433650"
May 27 02:02:01.287864 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:01.287829    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:01.288081 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:01.287829    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:02:01.858772 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:01.858733    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-59jjz" podUID="7a970a1a-c99e-4f0d-a29c-8d6e82e1387b"
May 27 02:02:05.542362 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.542281    2547 patch_prober.go:28] interesting pod/image-registry-57799b9bc4-zxbg8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 02:02:05.542362 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.542342    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 02:02:05.552613 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.552586    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:02:05.552669 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.552619    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:05.554916 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.554885    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5751e0c-f5c3-4a46-b923-50fcc933aee6-metrics-tls\") pod \"dns-default-g7pt9\" (UID: \"b5751e0c-f5c3-4a46-b923-50fcc933aee6\") " pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:05.555054 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.554933    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af96246-6bcb-407a-9ff7-06df15433650-cert\") pod \"ingress-canary-64q6v\" (UID: \"5af96246-6bcb-407a-9ff7-06df15433650\") " pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:02:05.791694 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.791663    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ngvd\""
May 27 02:02:05.792478 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.792436    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tmrqj\""
May 27 02:02:05.799258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.799241    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64q6v"
May 27 02:02:05.799360 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.799345    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:05.929383 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.929250    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7pt9"]
May 27 02:02:05.932150 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:05.932122    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5751e0c_f5c3_4a46_b923_50fcc933aee6.slice/crio-e72862e11962beafd682f2e6eeb623b675f91ac359f4483997cf9143a8e0e53d WatchSource:0}: Error finding container e72862e11962beafd682f2e6eeb623b675f91ac359f4483997cf9143a8e0e53d: Status 404 returned error can't find the container with id e72862e11962beafd682f2e6eeb623b675f91ac359f4483997cf9143a8e0e53d
May 27 02:02:05.952802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:05.952770    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64q6v"]
May 27 02:02:05.956053 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:05.956025    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af96246_6bcb_407a_9ff7_06df15433650.slice/crio-90153c5aaccc14742276bcac59bef11e8b2382a0ea6a9a1cc35399942ea8f60a WatchSource:0}: Error finding container 90153c5aaccc14742276bcac59bef11e8b2382a0ea6a9a1cc35399942ea8f60a: Status 404 returned error can't find the container with id 90153c5aaccc14742276bcac59bef11e8b2382a0ea6a9a1cc35399942ea8f60a
May 27 02:02:06.301124 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:06.301088    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7pt9" event={"ID":"b5751e0c-f5c3-4a46-b923-50fcc933aee6","Type":"ContainerStarted","Data":"e72862e11962beafd682f2e6eeb623b675f91ac359f4483997cf9143a8e0e53d"}
May 27 02:02:06.302012 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:06.301955    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64q6v" event={"ID":"5af96246-6bcb-407a-9ff7-06df15433650","Type":"ContainerStarted","Data":"90153c5aaccc14742276bcac59bef11e8b2382a0ea6a9a1cc35399942ea8f60a"}
May 27 02:02:07.611786 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.611752    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"]
May 27 02:02:07.615576 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.615556    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.618441 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.618406    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 02:02:07.618662 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.618644    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 27 02:02:07.619559 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.619500    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 02:02:07.619664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.619558    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 02:02:07.619664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.619565    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 27 02:02:07.619937 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.619916    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fwdrk\""
May 27 02:02:07.626038 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.626013    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"]
May 27 02:02:07.628925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.628905    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"]
May 27 02:02:07.632049 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.632032    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.634550 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.634529    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cl84j\""
May 27 02:02:07.634698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.634639    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 27 02:02:07.634924 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.634910    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 27 02:02:07.635528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.635514    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 27 02:02:07.643157 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.643136    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"]
May 27 02:02:07.671510 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.671488    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8bqgz"]
May 27 02:02:07.674741 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.674720    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.678712 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.678691    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 02:02:07.678712 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.678703    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 02:02:07.678867 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.678755    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpglj\""
May 27 02:02:07.679620 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.679604    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 02:02:07.771336 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771263    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771336 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771322    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.771336 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771351    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338f5042-72db-4f6d-8b22-592a24f11131-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771381    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-sys\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771441    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771474    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771496    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-textfile\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-metrics-client-ca\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-tls\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771629 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771619    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l87m\" (UniqueName: \"kubernetes.io/projected/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-api-access-7l87m\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771668    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nnh\" (UniqueName: \"kubernetes.io/projected/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-kube-api-access-w7nnh\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771725    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771790    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5e21a6-99df-4da5-a356-1c41dbd452c5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771819    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771846    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-root\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771875    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrv2r\" (UniqueName: \"kubernetes.io/projected/338f5042-72db-4f6d-8b22-592a24f11131-kube-api-access-xrv2r\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.771993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.771899    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-wtmp\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872241 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872212    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5e21a6-99df-4da5-a356-1c41dbd452c5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.872346 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872266    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.872346 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872293    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-root\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872346 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872319    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv2r\" (UniqueName: \"kubernetes.io/projected/338f5042-72db-4f6d-8b22-592a24f11131-kube-api-access-xrv2r\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872349    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-wtmp\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872385    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872417    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872445    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338f5042-72db-4f6d-8b22-592a24f11131-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872448    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-root\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872474    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-sys\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872523    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-sys\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872553    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.872783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872589    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5e21a6-99df-4da5-a356-1c41dbd452c5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.872930 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872871    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-wtmp\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873205    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.872593    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873269    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-textfile\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873300    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-metrics-client-ca\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873346    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-tls\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873383    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873413    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7l87m\" (UniqueName: \"kubernetes.io/projected/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-api-access-7l87m\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873439    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nnh\" (UniqueName: \"kubernetes.io/projected/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-kube-api-access-w7nnh\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873469    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873499    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.873741    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338f5042-72db-4f6d-8b22-592a24f11131-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.874177    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.874574    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-metrics-client-ca\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.874684    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.874983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.874822    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-textfile\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.875762 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.875684    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.876026 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.875994    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.876399 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.876375    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.877497 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.877451    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/338f5042-72db-4f6d-8b22-592a24f11131-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.878423 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.878376    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-node-exporter-tls\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.878501 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.878456    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.885877 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.885692    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l87m\" (UniqueName: \"kubernetes.io/projected/dc5e21a6-99df-4da5-a356-1c41dbd452c5-kube-api-access-7l87m\") pod \"kube-state-metrics-54fd6bc5c4-4jjsk\" (UID: \"dc5e21a6-99df-4da5-a356-1c41dbd452c5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.885877 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.885823    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nnh\" (UniqueName: \"kubernetes.io/projected/ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2-kube-api-access-w7nnh\") pod \"node-exporter-8bqgz\" (UID: \"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2\") " pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:07.886056 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.885929    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrv2r\" (UniqueName: \"kubernetes.io/projected/338f5042-72db-4f6d-8b22-592a24f11131-kube-api-access-xrv2r\") pod \"openshift-state-metrics-9c959559f-p2s4f\" (UID: \"338f5042-72db-4f6d-8b22-592a24f11131\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.928251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.928228    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"
May 27 02:02:07.941610 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.941590    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"
May 27 02:02:07.990337 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:07.985701    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8bqgz"
May 27 02:02:08.112342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.112236    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk"]
May 27 02:02:08.116812 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:08.116784    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5e21a6_99df_4da5_a356_1c41dbd452c5.slice/crio-937cd9105c61d5943cdd1b9457f6b612b22515816a4179fbe90c1aa58448ee73 WatchSource:0}: Error finding container 937cd9105c61d5943cdd1b9457f6b612b22515816a4179fbe90c1aa58448ee73: Status 404 returned error can't find the container with id 937cd9105c61d5943cdd1b9457f6b612b22515816a4179fbe90c1aa58448ee73
May 27 02:02:08.131072 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.131041    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f"]
May 27 02:02:08.134354 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:08.134325    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338f5042_72db_4f6d_8b22_592a24f11131.slice/crio-fd5b97230dbcfb30eb5457afcce6536b9220d123aebda48209cde47cd1a8721b WatchSource:0}: Error finding container fd5b97230dbcfb30eb5457afcce6536b9220d123aebda48209cde47cd1a8721b: Status 404 returned error can't find the container with id fd5b97230dbcfb30eb5457afcce6536b9220d123aebda48209cde47cd1a8721b
May 27 02:02:08.308813 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.308779    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk" event={"ID":"dc5e21a6-99df-4da5-a356-1c41dbd452c5","Type":"ContainerStarted","Data":"937cd9105c61d5943cdd1b9457f6b612b22515816a4179fbe90c1aa58448ee73"}
May 27 02:02:08.310085 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.310054    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64q6v" event={"ID":"5af96246-6bcb-407a-9ff7-06df15433650","Type":"ContainerStarted","Data":"c405058ec1d57eab83e105432d68b6e2e2a2a87a9704a846db2636a17f11ece0"}
May 27 02:02:08.311031 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.311009    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bqgz" event={"ID":"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2","Type":"ContainerStarted","Data":"86c5a41a0ae55f31621530d76a2f11afadc1d241a78b7c38f7a8368f3b5be2e2"}
May 27 02:02:08.312341 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.312320    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f" event={"ID":"338f5042-72db-4f6d-8b22-592a24f11131","Type":"ContainerStarted","Data":"cc345fdb5f4d880393ad3b434b5941653bafe46e8aa64d49a52ca8242c19b54d"}
May 27 02:02:08.312435 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.312350    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f" event={"ID":"338f5042-72db-4f6d-8b22-592a24f11131","Type":"ContainerStarted","Data":"030f75e681fb6860022810a1da32d3e12b2b9aee2a5adc1f040dbb8220190991"}
May 27 02:02:08.312435 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.312363    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f" event={"ID":"338f5042-72db-4f6d-8b22-592a24f11131","Type":"ContainerStarted","Data":"fd5b97230dbcfb30eb5457afcce6536b9220d123aebda48209cde47cd1a8721b"}
May 27 02:02:08.313690 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.313670    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7pt9" event={"ID":"b5751e0c-f5c3-4a46-b923-50fcc933aee6","Type":"ContainerStarted","Data":"007a17ca73ee6ceda103413f537e4ec66a07bce2b856f45c490653be126a4ce6"}
May 27 02:02:08.313690 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.313693    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7pt9" event={"ID":"b5751e0c-f5c3-4a46-b923-50fcc933aee6","Type":"ContainerStarted","Data":"a20b918613b64139f17fbbe9bc68039bbd387d510d2ab5c09a76d07601aacce0"}
May 27 02:02:08.313828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.313817    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:08.333482 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.333443    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-64q6v" podStartSLOduration=129.436393501 podStartE2EDuration="2m11.333430462s" podCreationTimestamp="2026-05-27 01:59:57 +0000 UTC" firstStartedPulling="2026-05-27 02:02:05.957644084 +0000 UTC m=+162.752888490" lastFinishedPulling="2026-05-27 02:02:07.854681044 +0000 UTC m=+164.649925451" observedRunningTime="2026-05-27 02:02:08.332427413 +0000 UTC m=+165.127671839" watchObservedRunningTime="2026-05-27 02:02:08.333430462 +0000 UTC m=+165.128674887"
May 27 02:02:08.353994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:08.353936    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-g7pt9" podStartSLOduration=129.437509859 podStartE2EDuration="2m11.353924381s" podCreationTimestamp="2026-05-27 01:59:57 +0000 UTC" firstStartedPulling="2026-05-27 02:02:05.934453671 +0000 UTC m=+162.729698075" lastFinishedPulling="2026-05-27 02:02:07.850868194 +0000 UTC m=+164.646112597" observedRunningTime="2026-05-27 02:02:08.35352411 +0000 UTC m=+165.148768536" watchObservedRunningTime="2026-05-27 02:02:08.353924381 +0000 UTC m=+165.149168806"
May 27 02:02:09.318852 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:09.318796    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bqgz" event={"ID":"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2","Type":"ContainerStarted","Data":"4b2377d87a7f86cd6d1de96c9fc667d680d510bfd98826550db179808b316322"}
May 27 02:02:10.326063 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.326022    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk" event={"ID":"dc5e21a6-99df-4da5-a356-1c41dbd452c5","Type":"ContainerStarted","Data":"9d2f126d0d9c371611af424742b64e550689271cc80094bf03846fab9849eb3b"}
May 27 02:02:10.326063 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.326067    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk" event={"ID":"dc5e21a6-99df-4da5-a356-1c41dbd452c5","Type":"ContainerStarted","Data":"c9336f0643c95ba39f894420a8725d2c62cbb86ca5f012ea67a4234b9c63c0f8"}
May 27 02:02:10.326583 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.326080    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk" event={"ID":"dc5e21a6-99df-4da5-a356-1c41dbd452c5","Type":"ContainerStarted","Data":"bd962a5f0747d51a4e47e059f580d84656debae5536983cc4c850168f02bdebc"}
May 27 02:02:10.327235 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.327210    2547 generic.go:358] "Generic (PLEG): container finished" podID="ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2" containerID="4b2377d87a7f86cd6d1de96c9fc667d680d510bfd98826550db179808b316322" exitCode=0
May 27 02:02:10.327325 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.327275    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bqgz" event={"ID":"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2","Type":"ContainerDied","Data":"4b2377d87a7f86cd6d1de96c9fc667d680d510bfd98826550db179808b316322"}
May 27 02:02:10.329234 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.329210    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f" event={"ID":"338f5042-72db-4f6d-8b22-592a24f11131","Type":"ContainerStarted","Data":"819b827ec081997e488a18d47ce4a7ee7344549e4fb091de9b98592b887f1615"}
May 27 02:02:10.345397 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.345353    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4jjsk" podStartSLOduration=1.86400795 podStartE2EDuration="3.345338573s" podCreationTimestamp="2026-05-27 02:02:07 +0000 UTC" firstStartedPulling="2026-05-27 02:02:08.118794289 +0000 UTC m=+164.914038693" lastFinishedPulling="2026-05-27 02:02:09.600124912 +0000 UTC m=+166.395369316" observedRunningTime="2026-05-27 02:02:10.3435637 +0000 UTC m=+167.138808126" watchObservedRunningTime="2026-05-27 02:02:10.345338573 +0000 UTC m=+167.140583002"
May 27 02:02:10.361452 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.361415    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-p2s4f" podStartSLOduration=2.021079166 podStartE2EDuration="3.361404495s" podCreationTimestamp="2026-05-27 02:02:07 +0000 UTC" firstStartedPulling="2026-05-27 02:02:08.261456787 +0000 UTC m=+165.056701189" lastFinishedPulling="2026-05-27 02:02:09.601782115 +0000 UTC m=+166.397026518" observedRunningTime="2026-05-27 02:02:10.361289178 +0000 UTC m=+167.156533600" watchObservedRunningTime="2026-05-27 02:02:10.361404495 +0000 UTC m=+167.156648919"
May 27 02:02:10.842416 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:10.842384    2547 scope.go:117] "RemoveContainer" containerID="7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2"
May 27 02:02:10.842571 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:10.842553    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-vjvz5_openshift-console-operator(c06ce271-5849-45a8-a50d-8d4b0ec198b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podUID="c06ce271-5849-45a8-a50d-8d4b0ec198b5"
May 27 02:02:11.333642 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:11.333600    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bqgz" event={"ID":"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2","Type":"ContainerStarted","Data":"b784a48cd0fee795c42ed99a5ff526113d49b23c815fbbad2b54c0ff1243d640"}
May 27 02:02:11.333642 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:11.333644    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8bqgz" event={"ID":"ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2","Type":"ContainerStarted","Data":"e4fff28c31ad4aec88c9070437aa60dacd3c78071e5dc10f149aafaff9b97843"}
May 27 02:02:11.360614 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:11.360560    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8bqgz" podStartSLOduration=3.495752426 podStartE2EDuration="4.360548375s" podCreationTimestamp="2026-05-27 02:02:07 +0000 UTC" firstStartedPulling="2026-05-27 02:02:08.012425122 +0000 UTC m=+164.807669532" lastFinishedPulling="2026-05-27 02:02:08.877221079 +0000 UTC m=+165.672465481" observedRunningTime="2026-05-27 02:02:11.358396395 +0000 UTC m=+168.153640819" watchObservedRunningTime="2026-05-27 02:02:11.360548375 +0000 UTC m=+168.155792800"
May 27 02:02:12.052707 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.052677    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"]
May 27 02:02:12.055823 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.055805    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.058430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.058408    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 02:02:12.058534 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.058431    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 27 02:02:12.058534 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.058433    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 27 02:02:12.059599 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.059578    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pvmj6\""
May 27 02:02:12.059599 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.059592    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2ra2arfnr44pd\""
May 27 02:02:12.059743 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.059612    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 27 02:02:12.066704 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.066682    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"]
May 27 02:02:12.210783 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.210747    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-audit-log\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.210941 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.210787    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-client-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.210941 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.210823    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-tls\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.210941 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.210868    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-metrics-server-audit-profiles\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.211100 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.210944    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-client-certs\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.211100 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.211008    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.211100 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.211044    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzwx\" (UniqueName: \"kubernetes.io/projected/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-kube-api-access-jfzwx\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311665 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311590    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-client-certs\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311665 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311625    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311665 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311647    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzwx\" (UniqueName: \"kubernetes.io/projected/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-kube-api-access-jfzwx\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311693    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-audit-log\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311709    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-client-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311736    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-tls\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.311889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.311773    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-metrics-server-audit-profiles\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.312395 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.312159    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-audit-log\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.312498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.312468    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.312832 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.312808    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-metrics-server-audit-profiles\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.314690 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.314664    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-client-certs\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.314846 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.314828    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-client-ca-bundle\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.314989 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.314943    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-secret-metrics-server-tls\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.321917 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.321893    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzwx\" (UniqueName: \"kubernetes.io/projected/24f06f18-e3d0-4dd5-b1d1-83f62ed61353-kube-api-access-jfzwx\") pod \"metrics-server-7bdbfc5547-mvj6r\" (UID: \"24f06f18-e3d0-4dd5-b1d1-83f62ed61353\") " pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.364568 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.364542    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:12.364901 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.364882    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-78874"]
May 27 02:02:12.369247 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.369230    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:12.371632 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.371614    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-68jt7\""
May 27 02:02:12.371717 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.371661    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 27 02:02:12.377266 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.377243    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-78874"]
May 27 02:02:12.486348 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.486320    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"]
May 27 02:02:12.489160 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:12.489129    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f06f18_e3d0_4dd5_b1d1_83f62ed61353.slice/crio-43bd5a8d570d83c803ab536374746d9982932450cce999ec3dccc1a30b0b0b44 WatchSource:0}: Error finding container 43bd5a8d570d83c803ab536374746d9982932450cce999ec3dccc1a30b0b0b44: Status 404 returned error can't find the container with id 43bd5a8d570d83c803ab536374746d9982932450cce999ec3dccc1a30b0b0b44
May 27 02:02:12.513948 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.513919    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-78874\" (UID: \"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:12.615361 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:12.615307    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-78874\" (UID: \"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:12.615461 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:12.615404    2547 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 27 02:02:12.615461 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:12.615450    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert podName:1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107 nodeName:}" failed. No retries permitted until 2026-05-27 02:02:13.11543663 +0000 UTC m=+169.910681032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-78874" (UID: "1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107") : secret "monitoring-plugin-cert" not found
May 27 02:02:13.119197 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.119149    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-78874\" (UID: \"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:13.121686 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.121664    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-78874\" (UID: \"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:13.288926 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.288897    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:13.342098 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.342038    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r" event={"ID":"24f06f18-e3d0-4dd5-b1d1-83f62ed61353","Type":"ContainerStarted","Data":"43bd5a8d570d83c803ab536374746d9982932450cce999ec3dccc1a30b0b0b44"}
May 27 02:02:13.430492 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.430460    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-78874"]
May 27 02:02:13.791577 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:13.791539    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7d5bf5_d81d_4fc3_a97a_ed1e6f75e107.slice/crio-cea0602ba8db1ed8d87645957b031c984e96dce86b996ceb20bc0a9d2fc42650 WatchSource:0}: Error finding container cea0602ba8db1ed8d87645957b031c984e96dce86b996ceb20bc0a9d2fc42650: Status 404 returned error can't find the container with id cea0602ba8db1ed8d87645957b031c984e96dce86b996ceb20bc0a9d2fc42650
May 27 02:02:13.844625 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:13.844603    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:02:14.345878 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:14.345842    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874" event={"ID":"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107","Type":"ContainerStarted","Data":"cea0602ba8db1ed8d87645957b031c984e96dce86b996ceb20bc0a9d2fc42650"}
May 27 02:02:14.347017 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:14.346997    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r" event={"ID":"24f06f18-e3d0-4dd5-b1d1-83f62ed61353","Type":"ContainerStarted","Data":"596387b7866e430b4f37edf512f3b4b573b2c5b72bc0188eafdc3f5605e0be18"}
May 27 02:02:14.367367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:14.367317    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r" podStartSLOduration=1.020565789 podStartE2EDuration="2.367304697s" podCreationTimestamp="2026-05-27 02:02:12 +0000 UTC" firstStartedPulling="2026-05-27 02:02:12.491021199 +0000 UTC m=+169.286265601" lastFinishedPulling="2026-05-27 02:02:13.837760102 +0000 UTC m=+170.633004509" observedRunningTime="2026-05-27 02:02:14.36569628 +0000 UTC m=+171.160940705" watchObservedRunningTime="2026-05-27 02:02:14.367304697 +0000 UTC m=+171.162549178"
May 27 02:02:15.351529 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.351430    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874" event={"ID":"1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107","Type":"ContainerStarted","Data":"f9ddb6e76e01668d85caf27888920c74f845dd984490be54becc5ffb3dde6714"}
May 27 02:02:15.351901 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.351671    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:15.357216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.357133    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874"
May 27 02:02:15.401566 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.401520    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-78874" podStartSLOduration=2.157818952 podStartE2EDuration="3.401506616s" podCreationTimestamp="2026-05-27 02:02:12 +0000 UTC" firstStartedPulling="2026-05-27 02:02:13.793584931 +0000 UTC m=+170.588829334" lastFinishedPulling="2026-05-27 02:02:15.037272595 +0000 UTC m=+171.832516998" observedRunningTime="2026-05-27 02:02:15.372427654 +0000 UTC m=+172.167672081" watchObservedRunningTime="2026-05-27 02:02:15.401506616 +0000 UTC m=+172.196751040"
May 27 02:02:15.541496 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.541453    2547 patch_prober.go:28] interesting pod/image-registry-57799b9bc4-zxbg8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 02:02:15.541686 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:15.541534    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 02:02:18.321235 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:18.321200    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g7pt9"
May 27 02:02:20.556036 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.555993    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry" containerID="cri-o://befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243" gracePeriod=30
May 27 02:02:20.795489 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.795468    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:02:20.976232 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976209    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976360 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976246    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976360 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976277    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppdbp\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976360 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976322    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976360 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976353    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976579 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976382    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976579 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976428    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976579 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976455    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets\") pod \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\" (UID: \"20bfee18-fa86-4a7c-9ef4-10536eb4af35\") "
May 27 02:02:20.976801 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976766    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:02:20.977016 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.976798    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:02:20.977217 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.977191    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-certificates\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:20.977323 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.977222    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20bfee18-fa86-4a7c-9ef4-10536eb4af35-trusted-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:20.978918 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.978891    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:02:20.979075 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.978953    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:02:20.979075 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.978983    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:02:20.979197 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.979134    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:02:20.979197 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.979162    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp" (OuterVolumeSpecName: "kube-api-access-ppdbp") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "kube-api-access-ppdbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:02:20.985106 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:20.985084    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "20bfee18-fa86-4a7c-9ef4-10536eb4af35" (UID: "20bfee18-fa86-4a7c-9ef4-10536eb4af35"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:02:21.077655 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077635    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-image-registry-private-configuration\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.077730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077657    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppdbp\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-kube-api-access-ppdbp\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.077730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077668    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20bfee18-fa86-4a7c-9ef4-10536eb4af35-ca-trust-extracted\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.077730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077678    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.077730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077687    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20bfee18-fa86-4a7c-9ef4-10536eb4af35-bound-sa-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.077730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.077696    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20bfee18-fa86-4a7c-9ef4-10536eb4af35-installation-pull-secrets\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:02:21.369133 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.369075    2547 generic.go:358] "Generic (PLEG): container finished" podID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerID="befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243" exitCode=0
May 27 02:02:21.369133 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.369115    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" event={"ID":"20bfee18-fa86-4a7c-9ef4-10536eb4af35","Type":"ContainerDied","Data":"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"}
May 27 02:02:21.369133 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.369129    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8"
May 27 02:02:21.369263 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.369136    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57799b9bc4-zxbg8" event={"ID":"20bfee18-fa86-4a7c-9ef4-10536eb4af35","Type":"ContainerDied","Data":"6d98bc5c9b7aea97c949e63bb1756005c26fdcc72c3441238574f5ea27a4c60d"}
May 27 02:02:21.369263 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.369154    2547 scope.go:117] "RemoveContainer" containerID="befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"
May 27 02:02:21.378619 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.378529    2547 scope.go:117] "RemoveContainer" containerID="befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"
May 27 02:02:21.379089 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:02:21.379056    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243\": container with ID starting with befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243 not found: ID does not exist" containerID="befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"
May 27 02:02:21.379166 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.379100    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243"} err="failed to get container status \"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243\": rpc error: code = NotFound desc = could not find container \"befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243\": container with ID starting with befce52ff6af7e87dcf79709685ae29e0f22db64fd2e96ae102286bf92452243 not found: ID does not exist"
May 27 02:02:21.394200 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.394178    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:02:21.398586 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.398567    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57799b9bc4-zxbg8"]
May 27 02:02:21.841902 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.841879    2547 scope.go:117] "RemoveContainer" containerID="7c4d975089a87b10f27f921bad42d7c56d91be494481e847cfce9c5e910223e2"
May 27 02:02:21.845686 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:21.845666    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" path="/var/lib/kubelet/pods/20bfee18-fa86-4a7c-9ef4-10536eb4af35/volumes"
May 27 02:02:22.374312 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.374284    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:02:22.374474 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.374372    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" event={"ID":"c06ce271-5849-45a8-a50d-8d4b0ec198b5","Type":"ContainerStarted","Data":"80c9d24efbcff2e54bbe1cd13d0c1ee5be3aaae7db9ad742c0c749df44572ed2"}
May 27 02:02:22.374730 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.374710    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:02:22.379534 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.379512    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5"
May 27 02:02:22.380112 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.380093    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-k67p7"]
May 27 02:02:22.380351 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.380340    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry"
May 27 02:02:22.380390 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.380353    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry"
May 27 02:02:22.380422 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.380410    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="20bfee18-fa86-4a7c-9ef4-10536eb4af35" containerName="registry"
May 27 02:02:22.383223 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.383208    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:22.385790 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.385769    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbdb8\" (UniqueName: \"kubernetes.io/projected/eba16667-c3f5-4b85-b82d-2f031fc4c6fb-kube-api-access-kbdb8\") pod \"downloads-57bd96b888-k67p7\" (UID: \"eba16667-c3f5-4b85-b82d-2f031fc4c6fb\") " pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:22.386217 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.386198    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 27 02:02:22.386356 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.386342    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 27 02:02:22.386752 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.386737    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rtkn9\""
May 27 02:02:22.403954 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.403933    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k67p7"]
May 27 02:02:22.404488 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.404453    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-vjvz5" podStartSLOduration=54.724852909 podStartE2EDuration="57.404441514s" podCreationTimestamp="2026-05-27 02:01:25 +0000 UTC" firstStartedPulling="2026-05-27 02:01:25.710411094 +0000 UTC m=+122.505655497" lastFinishedPulling="2026-05-27 02:01:28.389999693 +0000 UTC m=+125.185244102" observedRunningTime="2026-05-27 02:02:22.401836296 +0000 UTC m=+179.197080720" watchObservedRunningTime="2026-05-27 02:02:22.404441514 +0000 UTC m=+179.199685941"
May 27 02:02:22.486791 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.486764    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdb8\" (UniqueName: \"kubernetes.io/projected/eba16667-c3f5-4b85-b82d-2f031fc4c6fb-kube-api-access-kbdb8\") pod \"downloads-57bd96b888-k67p7\" (UID: \"eba16667-c3f5-4b85-b82d-2f031fc4c6fb\") " pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:22.494856 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.494830    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbdb8\" (UniqueName: \"kubernetes.io/projected/eba16667-c3f5-4b85-b82d-2f031fc4c6fb-kube-api-access-kbdb8\") pod \"downloads-57bd96b888-k67p7\" (UID: \"eba16667-c3f5-4b85-b82d-2f031fc4c6fb\") " pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:22.691952 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.691896    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:22.822725 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:22.822692    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k67p7"]
May 27 02:02:22.825492 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:22.825463    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba16667_c3f5_4b85_b82d_2f031fc4c6fb.slice/crio-e6e509e73e66bf56c6a58c5eda23c2b0496cad61172176f6fe17c8c33b58f492 WatchSource:0}: Error finding container e6e509e73e66bf56c6a58c5eda23c2b0496cad61172176f6fe17c8c33b58f492: Status 404 returned error can't find the container with id e6e509e73e66bf56c6a58c5eda23c2b0496cad61172176f6fe17c8c33b58f492
May 27 02:02:23.379293 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:23.379256    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k67p7" event={"ID":"eba16667-c3f5-4b85-b82d-2f031fc4c6fb","Type":"ContainerStarted","Data":"e6e509e73e66bf56c6a58c5eda23c2b0496cad61172176f6fe17c8c33b58f492"}
May 27 02:02:32.364920 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.364887    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:32.365389 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.364935    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:32.704655 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.704582    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:02:32.711101 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.711081    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.714057 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.714028    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 27 02:02:32.714230 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.714105    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 27 02:02:32.715109 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.715086    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 27 02:02:32.715216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.715113    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cl5dv\""
May 27 02:02:32.715367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.715352    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 27 02:02:32.715463 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.715374    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 27 02:02:32.720439 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.720419    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:02:32.765917 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.765891    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.766064 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.765933    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.766064 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.766048    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.766175 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.766071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.766175 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.766091    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jhrb\" (UniqueName: \"kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.766175 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.766107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.866855 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.866825    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.866995 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.866862    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.866995 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.866930    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.866995 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.866990    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.867160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.867020    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jhrb\" (UniqueName: \"kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.867160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.867049    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.867797 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.867748    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.867797 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.867783    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.868117 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.868098    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.869648 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.869626    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.869986 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.869940    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:32.881561 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:32.881541    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jhrb\" (UniqueName: \"kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb\") pod \"console-656b6987b5-nh4w5\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") " pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:33.022790 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:33.022766    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:02:33.152319 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:33.152293    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:02:33.155195 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:33.155168    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39befe1d_11e0_4fe4_822b_f4b83ba99c18.slice/crio-a28ac3f852e2402e58e34ec15a54040d6a75343ed429801642c2e30cff1e7fc5 WatchSource:0}: Error finding container a28ac3f852e2402e58e34ec15a54040d6a75343ed429801642c2e30cff1e7fc5: Status 404 returned error can't find the container with id a28ac3f852e2402e58e34ec15a54040d6a75343ed429801642c2e30cff1e7fc5
May 27 02:02:33.411779 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:33.411696    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656b6987b5-nh4w5" event={"ID":"39befe1d-11e0-4fe4-822b-f4b83ba99c18","Type":"ContainerStarted","Data":"a28ac3f852e2402e58e34ec15a54040d6a75343ed429801642c2e30cff1e7fc5"}
May 27 02:02:35.671811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.671773    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:02:35.677071 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.677049    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.685406 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.685383    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 27 02:02:35.687318 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.687272    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:02:35.791974 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.791925    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmmhr\" (UniqueName: \"kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792136 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792042    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792136 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792082    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792247 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792152    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792247 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792215    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792325 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792256    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.792325 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.792281    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.892887 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.892854    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.892887 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.892892    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.892931    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.892947    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.893013    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.893036    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.893095    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmmhr\" (UniqueName: \"kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.893861 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.893792    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.894132 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.894095    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.894493 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.894468    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.894625 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.894514    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.895769 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.895743    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.896288 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.896264    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.901203 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.901181    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmmhr\" (UniqueName: \"kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr\") pod \"console-657f67fbd5-jx7vc\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") " pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:35.989103 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:35.989071    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:42.684183 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:42.684150    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:02:42.686734 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:02:42.686679    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cbae7f_c34c_4e6e_b282_38014421a6fb.slice/crio-a1d59257317b38392288c50388bb8b1378df8ecf3d7bdda4f5705274ba805d88 WatchSource:0}: Error finding container a1d59257317b38392288c50388bb8b1378df8ecf3d7bdda4f5705274ba805d88: Status 404 returned error can't find the container with id a1d59257317b38392288c50388bb8b1378df8ecf3d7bdda4f5705274ba805d88
May 27 02:02:43.444728 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.444647    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k67p7" event={"ID":"eba16667-c3f5-4b85-b82d-2f031fc4c6fb","Type":"ContainerStarted","Data":"9f1c29c183466262f0301b7116ddb4c9b4bbfe0134b728cff2afb2f9ef0d146d"}
May 27 02:02:43.444728 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.444701    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:43.447061 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.446642    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656b6987b5-nh4w5" event={"ID":"39befe1d-11e0-4fe4-822b-f4b83ba99c18","Type":"ContainerStarted","Data":"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"}
May 27 02:02:43.448157 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.448124    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f67fbd5-jx7vc" event={"ID":"a6cbae7f-c34c-4e6e-b282-38014421a6fb","Type":"ContainerStarted","Data":"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"}
May 27 02:02:43.448266 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.448158    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f67fbd5-jx7vc" event={"ID":"a6cbae7f-c34c-4e6e-b282-38014421a6fb","Type":"ContainerStarted","Data":"a1d59257317b38392288c50388bb8b1378df8ecf3d7bdda4f5705274ba805d88"}
May 27 02:02:43.451624 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.451600    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-k67p7"
May 27 02:02:43.470328 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.470278    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-k67p7" podStartSLOduration=1.690800568 podStartE2EDuration="21.470262946s" podCreationTimestamp="2026-05-27 02:02:22 +0000 UTC" firstStartedPulling="2026-05-27 02:02:22.827378923 +0000 UTC m=+179.622623326" lastFinishedPulling="2026-05-27 02:02:42.606841293 +0000 UTC m=+199.402085704" observedRunningTime="2026-05-27 02:02:43.469115327 +0000 UTC m=+200.264359771" watchObservedRunningTime="2026-05-27 02:02:43.470262946 +0000 UTC m=+200.265507374"
May 27 02:02:43.548854 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.548805    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-656b6987b5-nh4w5" podStartSLOduration=2.152510865 podStartE2EDuration="11.548785931s" podCreationTimestamp="2026-05-27 02:02:32 +0000 UTC" firstStartedPulling="2026-05-27 02:02:33.157082746 +0000 UTC m=+189.952327150" lastFinishedPulling="2026-05-27 02:02:42.553357799 +0000 UTC m=+199.348602216" observedRunningTime="2026-05-27 02:02:43.548229402 +0000 UTC m=+200.343473828" watchObservedRunningTime="2026-05-27 02:02:43.548785931 +0000 UTC m=+200.344030357"
May 27 02:02:43.549487 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:43.549442    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-657f67fbd5-jx7vc" podStartSLOduration=8.549429809 podStartE2EDuration="8.549429809s" podCreationTimestamp="2026-05-27 02:02:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:02:43.520053532 +0000 UTC m=+200.315297958" watchObservedRunningTime="2026-05-27 02:02:43.549429809 +0000 UTC m=+200.344674235"
May 27 02:02:45.989476 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:45.989438    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:45.989883 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:45.989494    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:45.996252 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:45.996225    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:46.462928 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:46.462843    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:02:46.514323 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:46.514294    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:02:52.370598 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:52.370568    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:52.374548 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:52.374525    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bdbfc5547-mvj6r"
May 27 02:02:53.022990 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:02:53.022948    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:03:04.512674 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:04.512640    2547 generic.go:358] "Generic (PLEG): container finished" podID="fdbecc2b-8cdd-4daf-8845-f023c82dc567" containerID="f87c873e76817cecff539fdafb27c656bc49d1d7c251c891d0c2c448e7faf050" exitCode=0
May 27 02:03:04.513090 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:04.512715    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-x2d48" event={"ID":"fdbecc2b-8cdd-4daf-8845-f023c82dc567","Type":"ContainerDied","Data":"f87c873e76817cecff539fdafb27c656bc49d1d7c251c891d0c2c448e7faf050"}
May 27 02:03:04.513090 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:04.513028    2547 scope.go:117] "RemoveContainer" containerID="f87c873e76817cecff539fdafb27c656bc49d1d7c251c891d0c2c448e7faf050"
May 27 02:03:05.143187 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:05.143161    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7pt9_b5751e0c-f5c3-4a46-b923-50fcc933aee6/dns/0.log"
May 27 02:03:05.149285 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:05.149263    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7pt9_b5751e0c-f5c3-4a46-b923-50fcc933aee6/kube-rbac-proxy/0.log"
May 27 02:03:05.196455 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:05.196436    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g2jbf_9914aa31-1af5-4a64-bb0b-8672c0df9c87/dns-node-resolver/0.log"
May 27 02:03:05.516869 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:05.516837    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-x2d48" event={"ID":"fdbecc2b-8cdd-4daf-8845-f023c82dc567","Type":"ContainerStarted","Data":"d7767249addfb31ebbc9073117f25dc31d0d60f6b1a2e9b1e92020656d020bc0"}
May 27 02:03:11.536921 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.536861    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-656b6987b5-nh4w5" podUID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" containerName="console" containerID="cri-o://823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd" gracePeriod=15
May 27 02:03:11.828639 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.828619    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-656b6987b5-nh4w5_39befe1d-11e0-4fe4-822b-f4b83ba99c18/console/0.log"
May 27 02:03:11.828739 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.828700    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:03:11.971600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971569    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.971754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971613    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.971754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971651    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.971754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971691    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.971754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971731    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.971976 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.971755    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jhrb\" (UniqueName: \"kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb\") pod \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\" (UID: \"39befe1d-11e0-4fe4-822b-f4b83ba99c18\") "
May 27 02:03:11.972121 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.972090    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca" (OuterVolumeSpecName: "service-ca") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:11.972189 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.972151    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:11.972189 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.972155    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config" (OuterVolumeSpecName: "console-config") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:03:11.973930 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.973901    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:11.974180 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.973929    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb" (OuterVolumeSpecName: "kube-api-access-8jhrb") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "kube-api-access-8jhrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:03:11.974180 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:11.974115    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39befe1d-11e0-4fe4-822b-f4b83ba99c18" (UID: "39befe1d-11e0-4fe4-822b-f4b83ba99c18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073279    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-oauth-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073306    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073316    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jhrb\" (UniqueName: \"kubernetes.io/projected/39befe1d-11e0-4fe4-822b-f4b83ba99c18-kube-api-access-8jhrb\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073327    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073337    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39befe1d-11e0-4fe4-822b-f4b83ba99c18-console-oauth-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.073355 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.073345    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39befe1d-11e0-4fe4-822b-f4b83ba99c18-service-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:03:12.534457 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534429    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-656b6987b5-nh4w5_39befe1d-11e0-4fe4-822b-f4b83ba99c18/console/0.log"
May 27 02:03:12.534618 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534467    2547 generic.go:358] "Generic (PLEG): container finished" podID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" containerID="823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd" exitCode=2
May 27 02:03:12.534618 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534534    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656b6987b5-nh4w5"
May 27 02:03:12.534618 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534538    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656b6987b5-nh4w5" event={"ID":"39befe1d-11e0-4fe4-822b-f4b83ba99c18","Type":"ContainerDied","Data":"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"}
May 27 02:03:12.534618 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534572    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656b6987b5-nh4w5" event={"ID":"39befe1d-11e0-4fe4-822b-f4b83ba99c18","Type":"ContainerDied","Data":"a28ac3f852e2402e58e34ec15a54040d6a75343ed429801642c2e30cff1e7fc5"}
May 27 02:03:12.534618 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.534590    2547 scope.go:117] "RemoveContainer" containerID="823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"
May 27 02:03:12.544648 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.544453    2547 scope.go:117] "RemoveContainer" containerID="823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"
May 27 02:03:12.544933 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:03:12.544745    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd\": container with ID starting with 823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd not found: ID does not exist" containerID="823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"
May 27 02:03:12.544933 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.544789    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd"} err="failed to get container status \"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd\": rpc error: code = NotFound desc = could not find container \"823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd\": container with ID starting with 823c27de9d55bb3dcd96ecb3666ee3dd75d7d3a7b084d842dfb818f15f1156cd not found: ID does not exist"
May 27 02:03:12.560134 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.560112    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:03:12.563368 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:12.563343    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-656b6987b5-nh4w5"]
May 27 02:03:13.845221 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:13.845186    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" path="/var/lib/kubelet/pods/39befe1d-11e0-4fe4-822b-f4b83ba99c18/volumes"
May 27 02:03:32.068195 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.068164    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"]
May 27 02:03:32.068617 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.068496    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" containerName="console"
May 27 02:03:32.068617 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.068510    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" containerName="console"
May 27 02:03:32.068617 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.068569    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="39befe1d-11e0-4fe4-822b-f4b83ba99c18" containerName="console"
May 27 02:03:32.071341 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.071321    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.074153 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074129    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 27 02:03:32.074262 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074136    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 27 02:03:32.074322 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074277    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 27 02:03:32.074386 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074369    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 27 02:03:32.074555 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074530    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 27 02:03:32.074677 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.074618    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dr4bh\""
May 27 02:03:32.079103 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.079082    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 27 02:03:32.083332 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.083314    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"]
May 27 02:03:32.229258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229353 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229270    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrtrw\" (UniqueName: \"kubernetes.io/projected/fafca018-6bab-495f-9f3b-a3a30a1f6190-kube-api-access-lrtrw\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229353 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229294    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229353 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229332    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-federate-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229509 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229377    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-metrics-client-ca\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229509 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229462    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229513    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-serving-certs-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.229607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.229548    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330707 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330645    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330707 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330687    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-serving-certs-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330842 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330735    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330842 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330778    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330842 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330809    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrtrw\" (UniqueName: \"kubernetes.io/projected/fafca018-6bab-495f-9f3b-a3a30a1f6190-kube-api-access-lrtrw\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.330842 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330832    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.331073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330850    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-federate-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.331073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.330866    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-metrics-client-ca\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.331637 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.331613    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-metrics-client-ca\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.331749 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.331613    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-serving-certs-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.331843 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.331821    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.333341 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.333311    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.333481 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.333459    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-secret-telemeter-client\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.333665 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.333651    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-federate-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.333701 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.333656    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fafca018-6bab-495f-9f3b-a3a30a1f6190-telemeter-client-tls\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.340141 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.340115    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrtrw\" (UniqueName: \"kubernetes.io/projected/fafca018-6bab-495f-9f3b-a3a30a1f6190-kube-api-access-lrtrw\") pod \"telemeter-client-6d97f9dccf-9zpj5\" (UID: \"fafca018-6bab-495f-9f3b-a3a30a1f6190\") " pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.380570 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.380553    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"
May 27 02:03:32.507254 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.507096    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5"]
May 27 02:03:32.509666 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:03:32.509637    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafca018_6bab_495f_9f3b_a3a30a1f6190.slice/crio-d7fc03c9aff1149fad2a2437b6a53c81bede27eb77804f77cb93b434b6bccf17 WatchSource:0}: Error finding container d7fc03c9aff1149fad2a2437b6a53c81bede27eb77804f77cb93b434b6bccf17: Status 404 returned error can't find the container with id d7fc03c9aff1149fad2a2437b6a53c81bede27eb77804f77cb93b434b6bccf17
May 27 02:03:32.593207 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:32.593154    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5" event={"ID":"fafca018-6bab-495f-9f3b-a3a30a1f6190","Type":"ContainerStarted","Data":"d7fc03c9aff1149fad2a2437b6a53c81bede27eb77804f77cb93b434b6bccf17"}
May 27 02:03:34.599716 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:34.599650    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5" event={"ID":"fafca018-6bab-495f-9f3b-a3a30a1f6190","Type":"ContainerStarted","Data":"944b7d4006afb209449f76aba80d0f9dccfcfcd7f257714a125e8e11af3840ce"}
May 27 02:03:35.558408 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.558336    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:03:35.560496 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.560467    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a970a1a-c99e-4f0d-a29c-8d6e82e1387b-metrics-certs\") pod \"network-metrics-daemon-59jjz\" (UID: \"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b\") " pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:03:35.604002 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.603975    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5" event={"ID":"fafca018-6bab-495f-9f3b-a3a30a1f6190","Type":"ContainerStarted","Data":"184d2532f826870dde42b625b16ca157d63d834b33cf655e34a41dc9e96b661a"}
May 27 02:03:35.604287 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.604006    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5" event={"ID":"fafca018-6bab-495f-9f3b-a3a30a1f6190","Type":"ContainerStarted","Data":"3d3d5840b7d49a61a446f0483384e1346e379c3bce84c768eab044e38eeb4f24"}
May 27 02:03:35.632335 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.632287    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d97f9dccf-9zpj5" podStartSLOduration=0.851698576 podStartE2EDuration="3.632273801s" podCreationTimestamp="2026-05-27 02:03:32 +0000 UTC" firstStartedPulling="2026-05-27 02:03:32.511453798 +0000 UTC m=+249.306698201" lastFinishedPulling="2026-05-27 02:03:35.292029022 +0000 UTC m=+252.087273426" observedRunningTime="2026-05-27 02:03:35.630746913 +0000 UTC m=+252.425991338" watchObservedRunningTime="2026-05-27 02:03:35.632273801 +0000 UTC m=+252.427518226"
May 27 02:03:35.747947 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.747923    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d6nl\""
May 27 02:03:35.756115 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.756091    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59jjz"
May 27 02:03:35.876173 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:35.876073    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-59jjz"]
May 27 02:03:35.879165 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:03:35.879138    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a970a1a_c99e_4f0d_a29c_8d6e82e1387b.slice/crio-666e587845242efabc309b946c6716cd68028dac63ca1872f204cb72038edd89 WatchSource:0}: Error finding container 666e587845242efabc309b946c6716cd68028dac63ca1872f204cb72038edd89: Status 404 returned error can't find the container with id 666e587845242efabc309b946c6716cd68028dac63ca1872f204cb72038edd89
May 27 02:03:36.412836 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.412804    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:03:36.415117 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.415096    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.425854 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.425822    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:03:36.567761 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.567725    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586lg\" (UniqueName: \"kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.567926 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.567768    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.567926 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.567800    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.567926 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.567884    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.568066 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.567999    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.568066 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.568028    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.568142 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.568076    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.609227 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.609176    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59jjz" event={"ID":"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b","Type":"ContainerStarted","Data":"666e587845242efabc309b946c6716cd68028dac63ca1872f204cb72038edd89"}
May 27 02:03:36.668750 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.668688    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.668750 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.668717    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.668942 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.668758    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.668942 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.668899    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-586lg\" (UniqueName: \"kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.668951    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669009    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669047    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669501 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669446    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669501 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669468    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.669664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669515    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.670027 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.669990    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.671628 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.671604    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.671929 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.671906    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.677107 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.677088    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586lg\" (UniqueName: \"kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg\") pod \"console-69746fdd7c-4428h\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") " pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:36.730645 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:36.730608    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:37.036271 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.036238    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:03:37.039634 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:03:37.039605    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103fc05d_db08_42ed_ac3f_02e763191e8d.slice/crio-0c96568b66c06c7207c1f37f846c768d201c4344d8be03111fb367f0d45e9e97 WatchSource:0}: Error finding container 0c96568b66c06c7207c1f37f846c768d201c4344d8be03111fb367f0d45e9e97: Status 404 returned error can't find the container with id 0c96568b66c06c7207c1f37f846c768d201c4344d8be03111fb367f0d45e9e97
May 27 02:03:37.613127 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.613096    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69746fdd7c-4428h" event={"ID":"103fc05d-db08-42ed-ac3f-02e763191e8d","Type":"ContainerStarted","Data":"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"}
May 27 02:03:37.613531 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.613132    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69746fdd7c-4428h" event={"ID":"103fc05d-db08-42ed-ac3f-02e763191e8d","Type":"ContainerStarted","Data":"0c96568b66c06c7207c1f37f846c768d201c4344d8be03111fb367f0d45e9e97"}
May 27 02:03:37.614699 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.614674    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59jjz" event={"ID":"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b","Type":"ContainerStarted","Data":"606e7d0e8206cdd5b571371b62a4ba12479743d1e93fd8a20bdef479e93e1692"}
May 27 02:03:37.614699 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.614699    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59jjz" event={"ID":"7a970a1a-c99e-4f0d-a29c-8d6e82e1387b","Type":"ContainerStarted","Data":"903114913dc0feb62e400350ea159190336135c1852a33b80e6802158ce01c3e"}
May 27 02:03:37.631864 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.631822    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-69746fdd7c-4428h" podStartSLOduration=1.631808585 podStartE2EDuration="1.631808585s" podCreationTimestamp="2026-05-27 02:03:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:03:37.629699426 +0000 UTC m=+254.424943851" watchObservedRunningTime="2026-05-27 02:03:37.631808585 +0000 UTC m=+254.427053007"
May 27 02:03:37.645806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:37.645763    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-59jjz" podStartSLOduration=253.624627528 podStartE2EDuration="4m14.645749931s" podCreationTimestamp="2026-05-27 01:59:23 +0000 UTC" firstStartedPulling="2026-05-27 02:03:35.881606377 +0000 UTC m=+252.676850794" lastFinishedPulling="2026-05-27 02:03:36.902728783 +0000 UTC m=+253.697973197" observedRunningTime="2026-05-27 02:03:37.644544616 +0000 UTC m=+254.439789042" watchObservedRunningTime="2026-05-27 02:03:37.645749931 +0000 UTC m=+254.440994356"
May 27 02:03:46.731361 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:46.731330    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:46.731759 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:46.731472    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:46.735889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:46.735868    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:47.648821 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:47.648795    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:03:47.700986 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:03:47.700942    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:04:12.720146 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:12.720105    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-657f67fbd5-jx7vc" podUID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" containerName="console" containerID="cri-o://027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b" gracePeriod=15
May 27 02:04:12.958187 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:12.958162    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657f67fbd5-jx7vc_a6cbae7f-c34c-4e6e-b282-38014421a6fb/console/0.log"
May 27 02:04:12.958304 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:12.958225    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:04:13.021758 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021688    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021758 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021757    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021776    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021793    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021824    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021843    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.021945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.021911    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmmhr\" (UniqueName: \"kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr\") pod \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\" (UID: \"a6cbae7f-c34c-4e6e-b282-38014421a6fb\") "
May 27 02:04:13.022219 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.022150    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:04:13.022273 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.022224    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:04:13.022273 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.022245    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:04:13.022356 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.022290    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config" (OuterVolumeSpecName: "console-config") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:04:13.023737 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.023707    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:04:13.023872 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.023853    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr" (OuterVolumeSpecName: "kube-api-access-pmmhr") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "kube-api-access-pmmhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:04:13.023914 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.023859    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6cbae7f-c34c-4e6e-b282-38014421a6fb" (UID: "a6cbae7f-c34c-4e6e-b282-38014421a6fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:04:13.122508 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122479    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmmhr\" (UniqueName: \"kubernetes.io/projected/a6cbae7f-c34c-4e6e-b282-38014421a6fb-kube-api-access-pmmhr\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122508 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122511    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-trusted-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122526    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122541    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-oauth-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122556    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-service-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122570    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.122698 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.122583    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6cbae7f-c34c-4e6e-b282-38014421a6fb-console-oauth-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:04:13.719970 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.719942    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657f67fbd5-jx7vc_a6cbae7f-c34c-4e6e-b282-38014421a6fb/console/0.log"
May 27 02:04:13.720155 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.720013    2547 generic.go:358] "Generic (PLEG): container finished" podID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" containerID="027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b" exitCode=2
May 27 02:04:13.720155 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.720063    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f67fbd5-jx7vc" event={"ID":"a6cbae7f-c34c-4e6e-b282-38014421a6fb","Type":"ContainerDied","Data":"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"}
May 27 02:04:13.720155 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.720088    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f67fbd5-jx7vc" event={"ID":"a6cbae7f-c34c-4e6e-b282-38014421a6fb","Type":"ContainerDied","Data":"a1d59257317b38392288c50388bb8b1378df8ecf3d7bdda4f5705274ba805d88"}
May 27 02:04:13.720155 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.720102    2547 scope.go:117] "RemoveContainer" containerID="027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"
May 27 02:04:13.720155 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.720117    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f67fbd5-jx7vc"
May 27 02:04:13.729499 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.729459    2547 scope.go:117] "RemoveContainer" containerID="027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"
May 27 02:04:13.730292 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:04:13.730261    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b\": container with ID starting with 027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b not found: ID does not exist" containerID="027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"
May 27 02:04:13.730459 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.730434    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b"} err="failed to get container status \"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b\": rpc error: code = NotFound desc = could not find container \"027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b\": container with ID starting with 027e1caa4e35198f9a3eaffce6c14d38f7c617e304d2608de9ab38e2af6de76b not found: ID does not exist"
May 27 02:04:13.746643 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.746619    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:04:13.749938 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.749915    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657f67fbd5-jx7vc"]
May 27 02:04:13.846482 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:13.846454    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" path="/var/lib/kubelet/pods/a6cbae7f-c34c-4e6e-b282-38014421a6fb/volumes"
May 27 02:04:23.727226 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:23.727182    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:04:23.729059 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:23.729021    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:04:23.733525 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:23.733506    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:04:23.735652 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:23.735633    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:04:23.736864 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:23.736846    2547 kubelet.go:1628] "Image garbage collection succeeded"
May 27 02:04:44.161318 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.161285    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:04:44.163889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.161577    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" containerName="console"
May 27 02:04:44.163889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.161589    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" containerName="console"
May 27 02:04:44.163889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.161649    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6cbae7f-c34c-4e6e-b282-38014421a6fb" containerName="console"
May 27 02:04:44.164728 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.164710    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.176162 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.176137    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:04:44.237622 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237622 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237625    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237652    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvjc\" (UniqueName: \"kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237669    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237751    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237780    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.237806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.237803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338777 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338748    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338792    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338811    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338838    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stvjc\" (UniqueName: \"kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338856    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338888    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.338925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.338906    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.339597 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.339572    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.339695 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.339596    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.339763 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.339711    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.339763 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.339748    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.341320 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.341295    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.341422 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.341384    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.346331 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.346311    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stvjc\" (UniqueName: \"kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc\") pod \"console-c44fb774d-cjgjv\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") " pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.474895 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.474869    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:44.599202 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.599177    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:04:44.601644 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:04:44.601616    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57263caa_55b9_487c_8484_0f2dff3ad81c.slice/crio-6bcb7512b14438051ed270ee09b656b14d27283911a8c33276528998979fd271 WatchSource:0}: Error finding container 6bcb7512b14438051ed270ee09b656b14d27283911a8c33276528998979fd271: Status 404 returned error can't find the container with id 6bcb7512b14438051ed270ee09b656b14d27283911a8c33276528998979fd271
May 27 02:04:44.603320 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.603303    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 02:04:44.809814 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.809740    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c44fb774d-cjgjv" event={"ID":"57263caa-55b9-487c-8484-0f2dff3ad81c","Type":"ContainerStarted","Data":"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"}
May 27 02:04:44.809814 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.809778    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c44fb774d-cjgjv" event={"ID":"57263caa-55b9-487c-8484-0f2dff3ad81c","Type":"ContainerStarted","Data":"6bcb7512b14438051ed270ee09b656b14d27283911a8c33276528998979fd271"}
May 27 02:04:44.829139 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:44.829075    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c44fb774d-cjgjv" podStartSLOduration=0.82906047 podStartE2EDuration="829.06047ms" podCreationTimestamp="2026-05-27 02:04:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:04:44.827426246 +0000 UTC m=+321.622670683" watchObservedRunningTime="2026-05-27 02:04:44.82906047 +0000 UTC m=+321.624304895"
May 27 02:04:54.475030 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:54.474993    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:54.475030 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:54.475040    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:54.479457 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:54.479433    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:54.841083 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:54.841002    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:04:54.895421 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:04:54.895391    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:05:19.915828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:19.915732    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-69746fdd7c-4428h" podUID="103fc05d-db08-42ed-ac3f-02e763191e8d" containerName="console" containerID="cri-o://83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8" gracePeriod=15
May 27 02:05:20.152490 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.152469    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69746fdd7c-4428h_103fc05d-db08-42ed-ac3f-02e763191e8d/console/0.log"
May 27 02:05:20.152602 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.152529    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:05:20.299670 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299647    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.299802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299692    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.299802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299718    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.299802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299745    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.299802 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299763    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.300098 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299821    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-586lg\" (UniqueName: \"kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.300098 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.299903    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert\") pod \"103fc05d-db08-42ed-ac3f-02e763191e8d\" (UID: \"103fc05d-db08-42ed-ac3f-02e763191e8d\") "
May 27 02:05:20.300098 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.300078    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:05:20.300314 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.300295    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-trusted-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.300379 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.300345    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:05:20.300379 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.300356    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config" (OuterVolumeSpecName: "console-config") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:05:20.300481 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.300394    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:05:20.301797 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.301774    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:05:20.302263 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.302242    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:05:20.302325 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.302297    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg" (OuterVolumeSpecName: "kube-api-access-586lg") pod "103fc05d-db08-42ed-ac3f-02e763191e8d" (UID: "103fc05d-db08-42ed-ac3f-02e763191e8d"). InnerVolumeSpecName "kube-api-access-586lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:05:20.400835 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400802    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.400835 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400833    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-console-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.400984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400844    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/103fc05d-db08-42ed-ac3f-02e763191e8d-console-oauth-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.400984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400855    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-service-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.400984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400864    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-586lg\" (UniqueName: \"kubernetes.io/projected/103fc05d-db08-42ed-ac3f-02e763191e8d-kube-api-access-586lg\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.400984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.400874    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/103fc05d-db08-42ed-ac3f-02e763191e8d-oauth-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:05:20.909744 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909709    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69746fdd7c-4428h_103fc05d-db08-42ed-ac3f-02e763191e8d/console/0.log"
May 27 02:05:20.909940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909758    2547 generic.go:358] "Generic (PLEG): container finished" podID="103fc05d-db08-42ed-ac3f-02e763191e8d" containerID="83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8" exitCode=2
May 27 02:05:20.909940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909841    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69746fdd7c-4428h"
May 27 02:05:20.909940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909853    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69746fdd7c-4428h" event={"ID":"103fc05d-db08-42ed-ac3f-02e763191e8d","Type":"ContainerDied","Data":"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"}
May 27 02:05:20.909940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909889    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69746fdd7c-4428h" event={"ID":"103fc05d-db08-42ed-ac3f-02e763191e8d","Type":"ContainerDied","Data":"0c96568b66c06c7207c1f37f846c768d201c4344d8be03111fb367f0d45e9e97"}
May 27 02:05:20.909940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.909904    2547 scope.go:117] "RemoveContainer" containerID="83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"
May 27 02:05:20.917880 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.917794    2547 scope.go:117] "RemoveContainer" containerID="83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"
May 27 02:05:20.918152 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:05:20.918077    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8\": container with ID starting with 83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8 not found: ID does not exist" containerID="83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"
May 27 02:05:20.918152 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.918101    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8"} err="failed to get container status \"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8\": rpc error: code = NotFound desc = could not find container \"83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8\": container with ID starting with 83ada6fa735ab394b89305f4a5c2ff9adeaa9e6aad6b2d97a9b9ff8b23e631e8 not found: ID does not exist"
May 27 02:05:20.931707 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.931681    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:05:20.935574 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:20.935544    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69746fdd7c-4428h"]
May 27 02:05:21.845397 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:21.845361    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="103fc05d-db08-42ed-ac3f-02e763191e8d" path="/var/lib/kubelet/pods/103fc05d-db08-42ed-ac3f-02e763191e8d/volumes"
May 27 02:05:28.652351 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.652311    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gqfqh"]
May 27 02:05:28.652748 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.652592    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103fc05d-db08-42ed-ac3f-02e763191e8d" containerName="console"
May 27 02:05:28.652748 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.652603    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="103fc05d-db08-42ed-ac3f-02e763191e8d" containerName="console"
May 27 02:05:28.652748 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.652655    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="103fc05d-db08-42ed-ac3f-02e763191e8d" containerName="console"
May 27 02:05:28.657220 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.657189    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.659701 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.659679    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 02:05:28.664206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.664180    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqfqh"]
May 27 02:05:28.758299 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.758272    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/393c5786-4415-4880-ade9-da9b65508447-original-pull-secret\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.758440 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.758329    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-kubelet-config\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.758440 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.758408    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-dbus\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.859616 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.859590    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-kubelet-config\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.859718 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.859626    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-dbus\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.859718 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.859671    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/393c5786-4415-4880-ade9-da9b65508447-original-pull-secret\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.859787 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.859714    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-kubelet-config\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.859869 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.859853    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/393c5786-4415-4880-ade9-da9b65508447-dbus\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.861887 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.861869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/393c5786-4415-4880-ade9-da9b65508447-original-pull-secret\") pod \"global-pull-secret-syncer-gqfqh\" (UID: \"393c5786-4415-4880-ade9-da9b65508447\") " pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:28.966705 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:28.966644    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqfqh"
May 27 02:05:29.088693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:29.088671    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqfqh"]
May 27 02:05:29.091157 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:05:29.091127    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393c5786_4415_4880_ade9_da9b65508447.slice/crio-dde99c124fb472aad7346f89d9563f2ecee8d09d3d32290cb25e9fac73116ed1 WatchSource:0}: Error finding container dde99c124fb472aad7346f89d9563f2ecee8d09d3d32290cb25e9fac73116ed1: Status 404 returned error can't find the container with id dde99c124fb472aad7346f89d9563f2ecee8d09d3d32290cb25e9fac73116ed1
May 27 02:05:29.936096 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:29.936060    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqfqh" event={"ID":"393c5786-4415-4880-ade9-da9b65508447","Type":"ContainerStarted","Data":"dde99c124fb472aad7346f89d9563f2ecee8d09d3d32290cb25e9fac73116ed1"}
May 27 02:05:33.950063 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:33.950030    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqfqh" event={"ID":"393c5786-4415-4880-ade9-da9b65508447","Type":"ContainerStarted","Data":"a8c1122eb315076c754ead0c9f300e7a3c2489cb44bb92396b30b978611a5c3e"}
May 27 02:05:33.964553 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:05:33.964508    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gqfqh" podStartSLOduration=1.208883756 podStartE2EDuration="5.96449068s" podCreationTimestamp="2026-05-27 02:05:28 +0000 UTC" firstStartedPulling="2026-05-27 02:05:29.092713715 +0000 UTC m=+365.887958119" lastFinishedPulling="2026-05-27 02:05:33.848320628 +0000 UTC m=+370.643565043" observedRunningTime="2026-05-27 02:05:33.963756738 +0000 UTC m=+370.759001164" watchObservedRunningTime="2026-05-27 02:05:33.96449068 +0000 UTC m=+370.759735108"
May 27 02:07:16.917747 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.917702    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:07:16.919844 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.919828    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:16.922530 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.922502    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-2tfgp\""
May 27 02:07:16.922646 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.922508    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 27 02:07:16.923378 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.923363    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 27 02:07:16.933288 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.933269    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6kk\" (UniqueName: \"kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk\") pod \"feast-operator-controller-manager-67dd5f7456-pljhf\" (UID: \"85686ef5-d0f0-48fd-b7ab-8c260f44a65f\") " pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:16.935667 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:16.935644    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:07:17.033583 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:17.033551    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6kk\" (UniqueName: \"kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk\") pod \"feast-operator-controller-manager-67dd5f7456-pljhf\" (UID: \"85686ef5-d0f0-48fd-b7ab-8c260f44a65f\") " pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:17.043287 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:17.043250    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6kk\" (UniqueName: \"kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk\") pod \"feast-operator-controller-manager-67dd5f7456-pljhf\" (UID: \"85686ef5-d0f0-48fd-b7ab-8c260f44a65f\") " pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:17.229795 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:17.229763    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:17.349847 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:17.349821    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:07:17.352266 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:07:17.352237    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85686ef5_d0f0_48fd_b7ab_8c260f44a65f.slice/crio-520309cb4cc16baa48f7edaa61b4e4a967ed71b942b84aa7195d135369a83c0e WatchSource:0}: Error finding container 520309cb4cc16baa48f7edaa61b4e4a967ed71b942b84aa7195d135369a83c0e: Status 404 returned error can't find the container with id 520309cb4cc16baa48f7edaa61b4e4a967ed71b942b84aa7195d135369a83c0e
May 27 02:07:18.244588 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:18.244544    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" event={"ID":"85686ef5-d0f0-48fd-b7ab-8c260f44a65f","Type":"ContainerStarted","Data":"520309cb4cc16baa48f7edaa61b4e4a967ed71b942b84aa7195d135369a83c0e"}
May 27 02:07:20.252158 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:20.252122    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" event={"ID":"85686ef5-d0f0-48fd-b7ab-8c260f44a65f","Type":"ContainerStarted","Data":"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"}
May 27 02:07:20.252530 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:20.252180    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:07:20.267119 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:20.267008    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" podStartSLOduration=1.9946277860000001 podStartE2EDuration="4.266990679s" podCreationTimestamp="2026-05-27 02:07:16 +0000 UTC" firstStartedPulling="2026-05-27 02:07:17.354065576 +0000 UTC m=+474.149309979" lastFinishedPulling="2026-05-27 02:07:19.626428466 +0000 UTC m=+476.421672872" observedRunningTime="2026-05-27 02:07:20.266312703 +0000 UTC m=+477.061557129" watchObservedRunningTime="2026-05-27 02:07:20.266990679 +0000 UTC m=+477.062235105"
May 27 02:07:31.256803 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:07:31.256771    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:08:00.208302 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.208266    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:08:00.217338 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.217317    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.221481    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.221791    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222048    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-44j2d\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222325    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222420    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222618    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222917    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 27 02:08:00.223539 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.222941    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 02:08:00.226919 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.226892    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:08:00.358159 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.358293 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mlv\" (UniqueName: \"kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.358335 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358296    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.358335 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358325    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.358432 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358352    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.358432 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.358422    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459363 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459287    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459363 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459329    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459363 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459348    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459372    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459392    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459417    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mlv\" (UniqueName: \"kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.459431    2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.459500    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls podName:d2effbea-e038-4959-9614-1a3ec0b599fd nodeName:}" failed. No retries permitted until 2026-05-27 02:08:00.959478806 +0000 UTC m=+517.754723208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls") pod "feast-simple-feast-setup-87fc7675b-w4dwz" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd") : secret "feast-simple-feast-setup-online-tls" not found
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.459513    2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 27 02:08:00.459609 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.459579    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls podName:d2effbea-e038-4959-9614-1a3ec0b599fd nodeName:}" failed. No retries permitted until 2026-05-27 02:08:00.959561815 +0000 UTC m=+517.754806230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls") pod "feast-simple-feast-setup-87fc7675b-w4dwz" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd") : secret "feast-simple-feast-setup-ui-tls" not found
May 27 02:08:00.459891 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.459803    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.461724 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.461702    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.461818 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.461755    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.468421 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.468401    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mlv\" (UniqueName: \"kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.963433 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.963401    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.963589 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.963500    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:00.963630 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.963599    2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 27 02:08:00.963680 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:08:00.963671    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls podName:d2effbea-e038-4959-9614-1a3ec0b599fd nodeName:}" failed. No retries permitted until 2026-05-27 02:08:01.963653455 +0000 UTC m=+518.758897881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls") pod "feast-simple-feast-setup-87fc7675b-w4dwz" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd") : secret "feast-simple-feast-setup-online-tls" not found
May 27 02:08:00.965825 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:00.965800    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:01.971405 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:01.971370    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:01.973664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:01.973645    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-w4dwz\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:02.046264 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:02.046229    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:02.181267 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:02.181242    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:08:02.183799 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:08:02.183770    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2effbea_e038_4959_9614_1a3ec0b599fd.slice/crio-7137e82994f118f731fd1302a4507eb586b958ab51e8f9b3d6865dbdb44f92ef WatchSource:0}: Error finding container 7137e82994f118f731fd1302a4507eb586b958ab51e8f9b3d6865dbdb44f92ef: Status 404 returned error can't find the container with id 7137e82994f118f731fd1302a4507eb586b958ab51e8f9b3d6865dbdb44f92ef
May 27 02:08:02.373185 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:02.373106    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"7137e82994f118f731fd1302a4507eb586b958ab51e8f9b3d6865dbdb44f92ef"}
May 27 02:08:39.488574 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:39.488529    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"3238b173f8b34de5fb9839134d383d1609f1dbbce6b8e7cea26276e4091f89ff"}
May 27 02:08:43.501409 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:43.501372    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="3238b173f8b34de5fb9839134d383d1609f1dbbce6b8e7cea26276e4091f89ff" exitCode=0
May 27 02:08:43.501764 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:43.501442    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"3238b173f8b34de5fb9839134d383d1609f1dbbce6b8e7cea26276e4091f89ff"}
May 27 02:08:44.506565 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:44.506530    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"4fed25a900150068e827ad9d686d64b189891bbf9e0ce1f084d203a9a830a771"}
May 27 02:08:49.522649 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:49.522611    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="4fed25a900150068e827ad9d686d64b189891bbf9e0ce1f084d203a9a830a771" exitCode=0
May 27 02:08:49.523025 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:49.522684    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"4fed25a900150068e827ad9d686d64b189891bbf9e0ce1f084d203a9a830a771"}
May 27 02:08:49.532415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:49.532394    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 27 02:08:50.529587 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:50.529548    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"72d4d95c967d34623112ba9f42a87d7a335e7208e083aa2157218281f637c7e2"}
May 27 02:08:50.530077 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:50.529599    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"062a916319ba086692e43eb2d7e80406413a697fb738ef03aef46ed472e819e4"}
May 27 02:08:50.530077 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:50.529615    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"5ebd35c188b63468dd9047fec212f04dd94e2708532c25b0bc24ca5742479a7d"}
May 27 02:08:50.530077 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:50.529627    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerStarted","Data":"a143112d4002a2b2da6cf180bc4450858e935d1c316208e9b96b7ca6acd11996"}
May 27 02:08:50.558028 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:50.557953    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podStartSLOduration=14.19468876 podStartE2EDuration="50.557933549s" podCreationTimestamp="2026-05-27 02:08:00 +0000 UTC" firstStartedPulling="2026-05-27 02:08:02.185412586 +0000 UTC m=+518.980656993" lastFinishedPulling="2026-05-27 02:08:38.548657371 +0000 UTC m=+555.343901782" observedRunningTime="2026-05-27 02:08:50.555938276 +0000 UTC m=+567.351182702" watchObservedRunningTime="2026-05-27 02:08:50.557933549 +0000 UTC m=+567.353177974"
May 27 02:08:52.047037 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:52.046996    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:52.047498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:52.047050    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:52.047498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:52.047065    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:52.047498 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:52.047077    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:53.046571 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.046538    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:53.046818 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.046797    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:53.046818 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.046821    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:53.047041 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.046834    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:53.049049 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.049012    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 27 02:08:53.049421 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.049026    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
May 27 02:08:53.049421 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.049195    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 27 02:08:53.049421 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:53.049293    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 27 02:08:56.047170 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.047135    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.047538 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.047302    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.047748 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.047723    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.048057 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.048030    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.048146 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.048099    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.048187 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.048171    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.052047 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.052021    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.429013 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.428943    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c785c9bbc-j74dd"]
May 27 02:08:56.433473 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.433452    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.443949 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.443929    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c785c9bbc-j74dd"]
May 27 02:08:56.518073 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518045    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4fl\" (UniqueName: \"kubernetes.io/projected/471d7e15-425d-4705-b96c-7dff83831681-kube-api-access-4l4fl\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-oauth-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518101    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-console-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518334 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518214    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-oauth-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518334 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-trusted-ca-bundle\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.518334 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.518308    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-service-ca\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.551406 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.551380    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:08:56.619512 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619481    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-oauth-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619518    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-trusted-ca-bundle\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619611    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-service-ca\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619734 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619650    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4fl\" (UniqueName: \"kubernetes.io/projected/471d7e15-425d-4705-b96c-7dff83831681-kube-api-access-4l4fl\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619734 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619686    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-oauth-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619837 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619734    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.619837 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.619756    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-console-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.620473 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.620448    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-trusted-ca-bundle\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.620626 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.620462    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-service-ca\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.620729 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.620647    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-console-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.620828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.620752    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/471d7e15-425d-4705-b96c-7dff83831681-oauth-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.622454 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.622431    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-oauth-config\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.622731 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.622705    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/471d7e15-425d-4705-b96c-7dff83831681-console-serving-cert\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.629011 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.628989    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4fl\" (UniqueName: \"kubernetes.io/projected/471d7e15-425d-4705-b96c-7dff83831681-kube-api-access-4l4fl\") pod \"console-c785c9bbc-j74dd\" (UID: \"471d7e15-425d-4705-b96c-7dff83831681\") " pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.743382 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.743362    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:08:56.875849 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:56.875821    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c785c9bbc-j74dd"]
May 27 02:08:56.878748 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:08:56.878708    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471d7e15_425d_4705_b96c_7dff83831681.slice/crio-825f1039ecb2e90b4a3e4621ed23c39db838d415cf19f497dc71ca84d053beb1 WatchSource:0}: Error finding container 825f1039ecb2e90b4a3e4621ed23c39db838d415cf19f497dc71ca84d053beb1: Status 404 returned error can't find the container with id 825f1039ecb2e90b4a3e4621ed23c39db838d415cf19f497dc71ca84d053beb1
May 27 02:08:57.553084 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:57.553051    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c785c9bbc-j74dd" event={"ID":"471d7e15-425d-4705-b96c-7dff83831681","Type":"ContainerStarted","Data":"02717505cc39dc761d947ec153874176705d4f006ee3e3dcb9e4c11324f36f2f"}
May 27 02:08:57.553084 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:57.553086    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c785c9bbc-j74dd" event={"ID":"471d7e15-425d-4705-b96c-7dff83831681","Type":"ContainerStarted","Data":"825f1039ecb2e90b4a3e4621ed23c39db838d415cf19f497dc71ca84d053beb1"}
May 27 02:08:57.571312 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:08:57.571270    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c785c9bbc-j74dd" podStartSLOduration=1.571253958 podStartE2EDuration="1.571253958s" podCreationTimestamp="2026-05-27 02:08:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:08:57.56983104 +0000 UTC m=+574.365075482" watchObservedRunningTime="2026-05-27 02:08:57.571253958 +0000 UTC m=+574.366498386"
May 27 02:09:06.743978 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:06.743928    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:09:06.744449 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:06.744004    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:09:06.748466 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:06.748444    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:09:07.590034 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:07.590005    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c785c9bbc-j74dd"
May 27 02:09:07.637407 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:07.637377    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:09:23.752648 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:23.752620    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:09:23.753160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:23.752620    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:09:23.758654 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:23.758636    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:09:23.758769 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:23.758637    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:09:32.657354 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:32.657318    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c44fb774d-cjgjv" podUID="57263caa-55b9-487c-8484-0f2dff3ad81c" containerName="console" containerID="cri-o://c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1" gracePeriod=15
May 27 02:09:32.934450 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:32.934427    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c44fb774d-cjgjv_57263caa-55b9-487c-8484-0f2dff3ad81c/console/0.log"
May 27 02:09:32.934552 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:32.934487    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:09:33.095370 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095343    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095370 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095374    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095547 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095511    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095606 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095549    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095606 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095575    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095606 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095592    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stvjc\" (UniqueName: \"kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095757 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095628    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config\") pod \"57263caa-55b9-487c-8484-0f2dff3ad81c\" (UID: \"57263caa-55b9-487c-8484-0f2dff3ad81c\") "
May 27 02:09:33.095994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095821    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca" (OuterVolumeSpecName: "service-ca") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:09:33.095994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095951    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:09:33.095994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.095991    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:09:33.096227 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.096167    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config" (OuterVolumeSpecName: "console-config") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:09:33.097493 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.097470    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:09:33.097880 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.097858    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:09:33.097971 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.097872    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc" (OuterVolumeSpecName: "kube-api-access-stvjc") pod "57263caa-55b9-487c-8484-0f2dff3ad81c" (UID: "57263caa-55b9-487c-8484-0f2dff3ad81c"). InnerVolumeSpecName "kube-api-access-stvjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198576    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-oauth-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198598    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-oauth-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198608    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-trusted-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198616    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stvjc\" (UniqueName: \"kubernetes.io/projected/57263caa-55b9-487c-8484-0f2dff3ad81c-kube-api-access-stvjc\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198626    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-console-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198634 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198635    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57263caa-55b9-487c-8484-0f2dff3ad81c-console-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.198945 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.198644    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57263caa-55b9-487c-8484-0f2dff3ad81c-service-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:09:33.662912 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.662893    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c44fb774d-cjgjv_57263caa-55b9-487c-8484-0f2dff3ad81c/console/0.log"
May 27 02:09:33.663209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.662928    2547 generic.go:358] "Generic (PLEG): container finished" podID="57263caa-55b9-487c-8484-0f2dff3ad81c" containerID="c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1" exitCode=2
May 27 02:09:33.663209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.663010    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c44fb774d-cjgjv" event={"ID":"57263caa-55b9-487c-8484-0f2dff3ad81c","Type":"ContainerDied","Data":"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"}
May 27 02:09:33.663209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.663026    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c44fb774d-cjgjv"
May 27 02:09:33.663209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.663043    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c44fb774d-cjgjv" event={"ID":"57263caa-55b9-487c-8484-0f2dff3ad81c","Type":"ContainerDied","Data":"6bcb7512b14438051ed270ee09b656b14d27283911a8c33276528998979fd271"}
May 27 02:09:33.663209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.663058    2547 scope.go:117] "RemoveContainer" containerID="c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"
May 27 02:09:33.671165 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.671148    2547 scope.go:117] "RemoveContainer" containerID="c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"
May 27 02:09:33.671407 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:09:33.671389    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1\": container with ID starting with c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1 not found: ID does not exist" containerID="c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"
May 27 02:09:33.671456 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.671415    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1"} err="failed to get container status \"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1\": rpc error: code = NotFound desc = could not find container \"c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1\": container with ID starting with c10ae6abc9cc77252d854b7a6341b0f75062c844f9e4921ebcf88778da494ae1 not found: ID does not exist"
May 27 02:09:33.684568 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.684550    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:09:33.687862 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.687843    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c44fb774d-cjgjv"]
May 27 02:09:33.845261 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:33.845215    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57263caa-55b9-487c-8484-0f2dff3ad81c" path="/var/lib/kubelet/pods/57263caa-55b9-487c-8484-0f2dff3ad81c/volumes"
May 27 02:09:59.494452 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.494418    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:09:59.497177 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.494862    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="registry" containerID="cri-o://a143112d4002a2b2da6cf180bc4450858e935d1c316208e9b96b7ca6acd11996" gracePeriod=30
May 27 02:09:59.497177 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.494919    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui" containerID="cri-o://72d4d95c967d34623112ba9f42a87d7a335e7208e083aa2157218281f637c7e2" gracePeriod=30
May 27 02:09:59.497177 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.494929    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online" containerID="cri-o://5ebd35c188b63468dd9047fec212f04dd94e2708532c25b0bc24ca5742479a7d" gracePeriod=30
May 27 02:09:59.497177 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.494929    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="offline" containerID="cri-o://062a916319ba086692e43eb2d7e80406413a697fb738ef03aef46ed472e819e4" gracePeriod=30
May 27 02:09:59.759116 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.759033    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:09:59.759490 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.759471    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57263caa-55b9-487c-8484-0f2dff3ad81c" containerName="console"
May 27 02:09:59.759613 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.759493    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="57263caa-55b9-487c-8484-0f2dff3ad81c" containerName="console"
May 27 02:09:59.759613 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.759570    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="57263caa-55b9-487c-8484-0f2dff3ad81c" containerName="console"
May 27 02:09:59.763057 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.763036    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.771775 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.766019    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-2b6sw\""
May 27 02:09:59.776806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.776782    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:09:59.784128 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784093    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.784223 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784173    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.784223 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784206    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.784310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784276    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.784350 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784307    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.784350 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.784333    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8ss\" (UniqueName: \"kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885042 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885002    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885042 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885052    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885086    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885114    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885138    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8ss\" (UniqueName: \"kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885175    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:09:59.885206    2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:09:59.885261    2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:09:59.885315    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls podName:86e34236-3d37-4f9c-a36b-cc7c189211ac nodeName:}" failed. No retries permitted until 2026-05-27 02:10:00.385289181 +0000 UTC m=+637.180533592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls") pod "feast-simple-feast-setup-87fc7675b-ck62h" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac") : secret "feast-simple-feast-setup-offline-tls" not found
May 27 02:09:59.885339 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:09:59.885337    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls podName:86e34236-3d37-4f9c-a36b-cc7c189211ac nodeName:}" failed. No retries permitted until 2026-05-27 02:10:00.385326428 +0000 UTC m=+637.180570843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls") pod "feast-simple-feast-setup-87fc7675b-ck62h" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac") : secret "feast-simple-feast-setup-ui-tls" not found
May 27 02:09:59.885682 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.885466    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.888040 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.888017    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.888182 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.888138    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:09:59.894644 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:09:59.894617    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8ss\" (UniqueName: \"kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.389191 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.389097    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.389191 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.389142    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.391608 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.391580    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.391715 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.391580    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") pod \"feast-simple-feast-setup-87fc7675b-ck62h\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") " pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.678194 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.678094    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:00.746952 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.746916    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="72d4d95c967d34623112ba9f42a87d7a335e7208e083aa2157218281f637c7e2" exitCode=0
May 27 02:10:00.747092 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.746952    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="5ebd35c188b63468dd9047fec212f04dd94e2708532c25b0bc24ca5742479a7d" exitCode=0
May 27 02:10:00.747092 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.746983    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"72d4d95c967d34623112ba9f42a87d7a335e7208e083aa2157218281f637c7e2"}
May 27 02:10:00.747092 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.747017    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"5ebd35c188b63468dd9047fec212f04dd94e2708532c25b0bc24ca5742479a7d"}
May 27 02:10:00.814078 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.814052    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:10:00.814682 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:10:00.814649    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86e34236_3d37_4f9c_a36b_cc7c189211ac.slice/crio-4616c3d3818b291b0bf52dfbf6c7e433ecd04341916fd6c06bfeabd339ddad5a WatchSource:0}: Error finding container 4616c3d3818b291b0bf52dfbf6c7e433ecd04341916fd6c06bfeabd339ddad5a: Status 404 returned error can't find the container with id 4616c3d3818b291b0bf52dfbf6c7e433ecd04341916fd6c06bfeabd339ddad5a
May 27 02:10:00.816386 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:00.816368    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 02:10:01.750970 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:01.750917    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"5aa29a0db066385ee338827bc446be72855645ff1c5c9afaba2845e5f4428e69"}
May 27 02:10:01.750970 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:01.750954    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"4616c3d3818b291b0bf52dfbf6c7e433ecd04341916fd6c06bfeabd339ddad5a"}
May 27 02:10:05.763753 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:05.763716    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="5aa29a0db066385ee338827bc446be72855645ff1c5c9afaba2845e5f4428e69" exitCode=0
May 27 02:10:05.764117 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:05.763787    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"5aa29a0db066385ee338827bc446be72855645ff1c5c9afaba2845e5f4428e69"}
May 27 02:10:06.049092 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:06.048668    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 27 02:10:06.548980 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:06.548924    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 27 02:10:06.769549 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:06.769515    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"b7df2e69f5de40984cafc25b21c72f05e232bcf8bf3d4450233f6affcc64d3a2"}
May 27 02:10:11.788276 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:11.788243    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="b7df2e69f5de40984cafc25b21c72f05e232bcf8bf3d4450233f6affcc64d3a2" exitCode=0
May 27 02:10:11.788619 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:11.788282    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"b7df2e69f5de40984cafc25b21c72f05e232bcf8bf3d4450233f6affcc64d3a2"}
May 27 02:10:12.796438 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:12.796387    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"2abfe8f3629c70ba412e9e7a6ce185f672e58550119a4e38daac7de0a989241d"}
May 27 02:10:12.796438 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:12.796444    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"d5346cf3d8b1704449fc586ba5f5445a14245f617a90c2f8b10156b594685c0d"}
May 27 02:10:12.796993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:12.796460    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"049f89621d1516a5e12ba41dd3f28b188559ff4425b26ff0f15529b352a2c95c"}
May 27 02:10:12.796993 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:12.796473    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerStarted","Data":"8d952271e8fbbf4808d4f23e9331635b9d9313acc5955f5b51a4c2590273a88f"}
May 27 02:10:12.822299 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:12.822232    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podStartSLOduration=13.82221329 podStartE2EDuration="13.82221329s" podCreationTimestamp="2026-05-27 02:09:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:10:12.820582291 +0000 UTC m=+649.615826716" watchObservedRunningTime="2026-05-27 02:10:12.82221329 +0000 UTC m=+649.617457716"
May 27 02:10:15.678393 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.678317    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:15.678393 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.678373    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:15.678393 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.678387    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:15.678393 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.678401    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:15.680151 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.680110    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 27 02:10:15.680289 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.680144    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.29:8816: connect: connection refused"
May 27 02:10:15.680289 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.680192    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused"
May 27 02:10:15.680289 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:15.680151    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 27 02:10:16.048511 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:16.048461    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 27 02:10:16.549362 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:16.549310    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 27 02:10:18.679980 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.679929    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680399 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680160    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680399 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680266    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680714 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680683    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680810 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680725    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680810 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680740    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.680810 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.680783    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.681096 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.681075    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.681165 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.681122    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.684472 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.684449    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.819670 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.819649    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:18.822376 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:18.822355    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:10:26.047916 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:26.047868    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 27 02:10:26.048324 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:26.048039    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:10:26.548819 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:26.548776    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 27 02:10:26.548987 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:26.548895    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:10:29.853190 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:29.853126    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="062a916319ba086692e43eb2d7e80406413a697fb738ef03aef46ed472e819e4" exitCode=137
May 27 02:10:29.853190 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:29.853148    2547 generic.go:358] "Generic (PLEG): container finished" podID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerID="a143112d4002a2b2da6cf180bc4450858e935d1c316208e9b96b7ca6acd11996" exitCode=137
May 27 02:10:29.853190 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:29.853187    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"062a916319ba086692e43eb2d7e80406413a697fb738ef03aef46ed472e819e4"}
May 27 02:10:29.853526 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:29.853205    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"a143112d4002a2b2da6cf180bc4450858e935d1c316208e9b96b7ca6acd11996"}
May 27 02:10:30.146400 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.146378    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:10:30.231015 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.230992    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231034    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231075    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8mlv\" (UniqueName: \"kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231096    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231114    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231135    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls\") pod \"d2effbea-e038-4959-9614-1a3ec0b599fd\" (UID: \"d2effbea-e038-4959-9614-1a3ec0b599fd\") "
May 27 02:10:30.231594 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.231562    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:10:30.233200 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.233150    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:10:30.233298 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.233262    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv" (OuterVolumeSpecName: "kube-api-access-l8mlv") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "kube-api-access-l8mlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:10:30.233338 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.233322    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:10:30.233533 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.233508    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:10:30.233533 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.233522    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d2effbea-e038-4959-9614-1a3ec0b599fd" (UID: "d2effbea-e038-4959-9614-1a3ec0b599fd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:10:30.332577 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332555    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.332577 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332574    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d2effbea-e038-4959-9614-1a3ec0b599fd-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.332693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332584    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8mlv\" (UniqueName: \"kubernetes.io/projected/d2effbea-e038-4959-9614-1a3ec0b599fd-kube-api-access-l8mlv\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.332693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332595    2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-ui-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.332693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332605    2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-offline-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.332693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.332614    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d2effbea-e038-4959-9614-1a3ec0b599fd-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:10:30.860382 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.860354    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz" event={"ID":"d2effbea-e038-4959-9614-1a3ec0b599fd","Type":"ContainerDied","Data":"7137e82994f118f731fd1302a4507eb586b958ab51e8f9b3d6865dbdb44f92ef"}
May 27 02:10:30.860382 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.860379    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"
May 27 02:10:30.860894 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.860396    2547 scope.go:117] "RemoveContainer" containerID="72d4d95c967d34623112ba9f42a87d7a335e7208e083aa2157218281f637c7e2"
May 27 02:10:30.869237 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.869221    2547 scope.go:117] "RemoveContainer" containerID="062a916319ba086692e43eb2d7e80406413a697fb738ef03aef46ed472e819e4"
May 27 02:10:30.876493 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.876476    2547 scope.go:117] "RemoveContainer" containerID="5ebd35c188b63468dd9047fec212f04dd94e2708532c25b0bc24ca5742479a7d"
May 27 02:10:30.882794 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.882771    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:10:30.884693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.884676    2547 scope.go:117] "RemoveContainer" containerID="a143112d4002a2b2da6cf180bc4450858e935d1c316208e9b96b7ca6acd11996"
May 27 02:10:30.889322 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.889304    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-w4dwz"]
May 27 02:10:30.892501 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.892485    2547 scope.go:117] "RemoveContainer" containerID="4fed25a900150068e827ad9d686d64b189891bbf9e0ce1f084d203a9a830a771"
May 27 02:10:30.899272 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:30.899257    2547 scope.go:117] "RemoveContainer" containerID="3238b173f8b34de5fb9839134d383d1609f1dbbce6b8e7cea26276e4091f89ff"
May 27 02:10:31.846223 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:10:31.846193    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" path="/var/lib/kubelet/pods/d2effbea-e038-4959-9614-1a3ec0b599fd/volumes"
May 27 02:11:21.378930 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.378899    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379232    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="feast-init"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379245    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="feast-init"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379252    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="registry"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379258    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="registry"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379267    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="feast-apply"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379274    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="feast-apply"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379290    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="offline"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379296    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="offline"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379302    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379307    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379316    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379321    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379369    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="offline"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379381    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="online"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379386    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="ui"
May 27 02:11:21.379394 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.379393    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2effbea-e038-4959-9614-1a3ec0b599fd" containerName="registry"
May 27 02:11:21.382882 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.382862    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.386006 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.385950    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 27 02:11:21.386206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386187    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 27 02:11:21.386310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386190    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 27 02:11:21.386310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386248    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 27 02:11:21.386310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386195    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 27 02:11:21.386310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386205    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 27 02:11:21.386310 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386216    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 27 02:11:21.386573 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.386208    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-zkn49\""
May 27 02:11:21.393301 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.393281    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:11:21.481718 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.481834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481735    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.481834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481761    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.481834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481782    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.481834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh6fc\" (UniqueName: \"kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.482010 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.481841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582495 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582476    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582505    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582525    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582547    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh6fc\" (UniqueName: \"kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582756 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582673    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.582756 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.582725    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.583063 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.583038    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.583552 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.583529    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.584849 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.584821    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.585048 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.585031    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.585158 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.585139    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.590609 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.590588    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh6fc\" (UniqueName: \"kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc\") pod \"feast-simple-feast-remote-setup-6d8497fdfd-gstq9\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.692588 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.692536    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:21.822828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:21.822803    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:11:21.825082 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:11:21.825049    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod779110a7_2605_47ef_b309_25b3a6b8283a.slice/crio-9a040832c949070a61d0bbce36e97558e841ac551d6b5be9434908f087dfcafb WatchSource:0}: Error finding container 9a040832c949070a61d0bbce36e97558e841ac551d6b5be9434908f087dfcafb: Status 404 returned error can't find the container with id 9a040832c949070a61d0bbce36e97558e841ac551d6b5be9434908f087dfcafb
May 27 02:11:22.008538 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:22.008501    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"}
May 27 02:11:22.008675 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:22.008547    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"9a040832c949070a61d0bbce36e97558e841ac551d6b5be9434908f087dfcafb"}
May 27 02:11:27.025332 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:27.025299    2547 generic.go:358] "Generic (PLEG): container finished" podID="779110a7-2605-47ef-b309-25b3a6b8283a" containerID="44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443" exitCode=0
May 27 02:11:27.025813 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:27.025362    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"}
May 27 02:11:28.030102 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:28.030065    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"}
May 27 02:11:33.048594 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:33.048563    2547 generic.go:358] "Generic (PLEG): container finished" podID="779110a7-2605-47ef-b309-25b3a6b8283a" containerID="81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356" exitCode=0
May 27 02:11:33.049018 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:33.048618    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"}
May 27 02:11:33.052096 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:33.052075    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 27 02:11:34.054561 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:34.054520    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"}
May 27 02:11:34.054922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:34.054574    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"}
May 27 02:11:34.054922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:34.054589    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerStarted","Data":"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"}
May 27 02:11:34.103742 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:34.103682    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podStartSLOduration=13.103664393 podStartE2EDuration="13.103664393s" podCreationTimestamp="2026-05-27 02:11:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:11:34.100366922 +0000 UTC m=+730.895611349" watchObservedRunningTime="2026-05-27 02:11:34.103664393 +0000 UTC m=+730.898908820"
May 27 02:11:36.693043 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.693006    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:36.693416 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.693056    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:36.693416 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.693070    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:36.694754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.694720    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.30:8816: connect: connection refused"
May 27 02:11:36.694754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.694742    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.30:8443: connect: connection refused"
May 27 02:11:36.694904 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:36.694755    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 27 02:11:39.694043 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694004    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.694607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694196    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.694607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694507    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.694607 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694541    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.694931 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694900    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.695064 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.694951    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:39.698513 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:39.698491    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:40.074955 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:40.074932    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:11:40.077715 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:11:40.077692    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:12:42.689335 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.689296    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:12:42.689920 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.689715    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online" containerID="cri-o://8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0" gracePeriod=30
May 27 02:12:42.689920 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.689811    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui" containerID="cri-o://7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81" gracePeriod=30
May 27 02:12:42.689920 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.689811    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="offline" containerID="cri-o://56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a" gracePeriod=30
May 27 02:12:42.798823 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.798791    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:12:42.799342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.799139    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="registry" containerID="cri-o://8d952271e8fbbf4808d4f23e9331635b9d9313acc5955f5b51a4c2590273a88f" gracePeriod=30
May 27 02:12:42.799342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.799192    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="offline" containerID="cri-o://d5346cf3d8b1704449fc586ba5f5445a14245f617a90c2f8b10156b594685c0d" gracePeriod=30
May 27 02:12:42.799342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.799214    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui" containerID="cri-o://2abfe8f3629c70ba412e9e7a6ce185f672e58550119a4e38daac7de0a989241d" gracePeriod=30
May 27 02:12:42.799342 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:42.799235    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online" containerID="cri-o://049f89621d1516a5e12ba41dd3f28b188559ff4425b26ff0f15529b352a2c95c" gracePeriod=30
May 27 02:12:44.265209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.265178    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="2abfe8f3629c70ba412e9e7a6ce185f672e58550119a4e38daac7de0a989241d" exitCode=0
May 27 02:12:44.265209 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.265205    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="049f89621d1516a5e12ba41dd3f28b188559ff4425b26ff0f15529b352a2c95c" exitCode=0
May 27 02:12:44.265616 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.265253    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"2abfe8f3629c70ba412e9e7a6ce185f672e58550119a4e38daac7de0a989241d"}
May 27 02:12:44.265616 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.265291    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"049f89621d1516a5e12ba41dd3f28b188559ff4425b26ff0f15529b352a2c95c"}
May 27 02:12:44.267472 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.267450    2547 generic.go:358] "Generic (PLEG): container finished" podID="779110a7-2605-47ef-b309-25b3a6b8283a" containerID="8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0" exitCode=0
May 27 02:12:44.267600 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:44.267525    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"}
May 27 02:12:46.275840 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:46.275810    2547 generic.go:358] "Generic (PLEG): container finished" podID="779110a7-2605-47ef-b309-25b3a6b8283a" containerID="7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81" exitCode=0
May 27 02:12:46.276153 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:46.275879    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"}
May 27 02:12:48.681074 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:48.681024    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 27 02:12:48.819751 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:48.819716    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 27 02:12:49.695581 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:49.695540    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.30:8443: connect: connection refused"
May 27 02:12:50.075729 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:50.075692    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 27 02:12:58.680690 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:58.680639    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 27 02:12:58.819755 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:58.819724    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 27 02:12:59.695009 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:12:59.694949    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.30:8443: connect: connection refused"
May 27 02:13:00.075860 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:00.075823    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 27 02:13:08.681649 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:08.681604    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 27 02:13:08.682068 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:08.681771    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:13:08.820173 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:08.820129    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 27 02:13:08.820362 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:08.820245    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:13:09.695221 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:09.695170    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.30:8443: connect: connection refused"
May 27 02:13:09.695601 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:09.695313    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:13:10.076023 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:10.075985    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 27 02:13:10.076193 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:10.076112    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:13:12.911352 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:12.911331    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:13:13.023850 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.023827    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.023992 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.023865    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.023992 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.023901    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.023992 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.023954    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.024171 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.024010    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.024171 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.024060    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh6fc\" (UniqueName: \"kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc\") pod \"779110a7-2605-47ef-b309-25b3a6b8283a\" (UID: \"779110a7-2605-47ef-b309-25b3a6b8283a\") "
May 27 02:13:13.024406 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.024346    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 02:13:13.024529 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.024506    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data" (OuterVolumeSpecName: "feast-data") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:13:13.025865 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.025840    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.025999 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.025940    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.026301 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.026276    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls" (OuterVolumeSpecName: "online-tls") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.026389 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.026294    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc" (OuterVolumeSpecName: "kube-api-access-jh6fc") pod "779110a7-2605-47ef-b309-25b3a6b8283a" (UID: "779110a7-2605-47ef-b309-25b3a6b8283a"). InnerVolumeSpecName "kube-api-access-jh6fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:13:13.124583 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124560    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/779110a7-2605-47ef-b309-25b3a6b8283a-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.124583 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124583    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/779110a7-2605-47ef-b309-25b3a6b8283a-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.124704 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124592    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh6fc\" (UniqueName: \"kubernetes.io/projected/779110a7-2605-47ef-b309-25b3a6b8283a-kube-api-access-jh6fc\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.124704 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124601    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.124704 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124610    2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-ui-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.124704 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.124617    2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/779110a7-2605-47ef-b309-25b3a6b8283a-offline-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.362099 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.362065    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="d5346cf3d8b1704449fc586ba5f5445a14245f617a90c2f8b10156b594685c0d" exitCode=137
May 27 02:13:13.362099 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.362092    2547 generic.go:358] "Generic (PLEG): container finished" podID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerID="8d952271e8fbbf4808d4f23e9331635b9d9313acc5955f5b51a4c2590273a88f" exitCode=137
May 27 02:13:13.362316 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.362133    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"d5346cf3d8b1704449fc586ba5f5445a14245f617a90c2f8b10156b594685c0d"}
May 27 02:13:13.362316 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.362168    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"8d952271e8fbbf4808d4f23e9331635b9d9313acc5955f5b51a4c2590273a88f"}
May 27 02:13:13.364358 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.364335    2547 generic.go:358] "Generic (PLEG): container finished" podID="779110a7-2605-47ef-b309-25b3a6b8283a" containerID="56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a" exitCode=137
May 27 02:13:13.364467 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.364397    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"}
May 27 02:13:13.364467 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.364420    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9" event={"ID":"779110a7-2605-47ef-b309-25b3a6b8283a","Type":"ContainerDied","Data":"9a040832c949070a61d0bbce36e97558e841ac551d6b5be9434908f087dfcafb"}
May 27 02:13:13.364467 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.364435    2547 scope.go:117] "RemoveContainer" containerID="7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"
May 27 02:13:13.364467 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.364442    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"
May 27 02:13:13.374110 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.374067    2547 scope.go:117] "RemoveContainer" containerID="56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"
May 27 02:13:13.382181 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.382160    2547 scope.go:117] "RemoveContainer" containerID="8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"
May 27 02:13:13.389898 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.389875    2547 scope.go:117] "RemoveContainer" containerID="81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"
May 27 02:13:13.390757 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.390731    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:13:13.397275 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.397253    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6d8497fdfd-gstq9"]
May 27 02:13:13.398229 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.398210    2547 scope.go:117] "RemoveContainer" containerID="44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"
May 27 02:13:13.404836 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.404820    2547 scope.go:117] "RemoveContainer" containerID="7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"
May 27 02:13:13.405080 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:13:13.405055    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81\": container with ID starting with 7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81 not found: ID does not exist" containerID="7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"
May 27 02:13:13.405143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405091    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81"} err="failed to get container status \"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81\": rpc error: code = NotFound desc = could not find container \"7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81\": container with ID starting with 7c21ac57d7d073aee2151054e05057d8972e85d4915181bfb0d8e51bd96aff81 not found: ID does not exist"
May 27 02:13:13.405143 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405117    2547 scope.go:117] "RemoveContainer" containerID="56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"
May 27 02:13:13.405358 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:13:13.405341    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a\": container with ID starting with 56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a not found: ID does not exist" containerID="56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"
May 27 02:13:13.405422 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405369    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a"} err="failed to get container status \"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a\": rpc error: code = NotFound desc = could not find container \"56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a\": container with ID starting with 56431b6c5511a0d662aa98a9016b12d3b8c804fa972e727c8872646542dbb34a not found: ID does not exist"
May 27 02:13:13.405422 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405391    2547 scope.go:117] "RemoveContainer" containerID="8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"
May 27 02:13:13.405600 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:13:13.405585    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0\": container with ID starting with 8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0 not found: ID does not exist" containerID="8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"
May 27 02:13:13.405661 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405606    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0"} err="failed to get container status \"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0\": rpc error: code = NotFound desc = could not find container \"8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0\": container with ID starting with 8082680aaada7ee8ee1f6ec2a3fedf7928c56f4dc0e1aa49ab00d4d670971da0 not found: ID does not exist"
May 27 02:13:13.405661 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405625    2547 scope.go:117] "RemoveContainer" containerID="81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"
May 27 02:13:13.405859 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:13:13.405842    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356\": container with ID starting with 81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356 not found: ID does not exist" containerID="81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"
May 27 02:13:13.405921 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405867    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356"} err="failed to get container status \"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356\": rpc error: code = NotFound desc = could not find container \"81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356\": container with ID starting with 81c246b44c9c7df2a6bd399b699008fabcb12760252dcd600c5a0a97fe7fa356 not found: ID does not exist"
May 27 02:13:13.405921 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.405887    2547 scope.go:117] "RemoveContainer" containerID="44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"
May 27 02:13:13.406143 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:13:13.406119    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443\": container with ID starting with 44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443 not found: ID does not exist" containerID="44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"
May 27 02:13:13.406190 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.406151    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443"} err="failed to get container status \"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443\": rpc error: code = NotFound desc = could not find container \"44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443\": container with ID starting with 44551e13446f4e1c285a1ab4b832ca0bca6770202f9deafc71c22efade139443 not found: ID does not exist"
May 27 02:13:13.440731 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.440717    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:13:13.528799 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.528779    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.528952 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.528817    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.528952 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.528848    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l8ss\" (UniqueName: \"kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.528952 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.528897    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.529136 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.528999    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.529136 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.529026    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") pod \"86e34236-3d37-4f9c-a36b-cc7c189211ac\" (UID: \"86e34236-3d37-4f9c-a36b-cc7c189211ac\") "
May 27 02:13:13.529559 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.529528    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data" (OuterVolumeSpecName: "feast-data") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:13:13.531003 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.530971    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.531003 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.530996    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.531122 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.531023    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss" (OuterVolumeSpecName: "kube-api-access-4l8ss") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "kube-api-access-4l8ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:13:13.531246 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.531226    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls" (OuterVolumeSpecName: "online-tls") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.531300 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.531284    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "86e34236-3d37-4f9c-a36b-cc7c189211ac" (UID: "86e34236-3d37-4f9c-a36b-cc7c189211ac"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:13:13.629922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629876    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.629922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629896    2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-ui-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.629922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629906    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l8ss\" (UniqueName: \"kubernetes.io/projected/86e34236-3d37-4f9c-a36b-cc7c189211ac-kube-api-access-4l8ss\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.629922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629916    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.630104 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629925    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e34236-3d37-4f9c-a36b-cc7c189211ac-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.630104 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.629933    2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/86e34236-3d37-4f9c-a36b-cc7c189211ac-offline-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:13:13.845521 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:13.845493    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" path="/var/lib/kubelet/pods/779110a7-2605-47ef-b309-25b3a6b8283a/volumes"
May 27 02:13:14.369621 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.369585    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h" event={"ID":"86e34236-3d37-4f9c-a36b-cc7c189211ac","Type":"ContainerDied","Data":"4616c3d3818b291b0bf52dfbf6c7e433ecd04341916fd6c06bfeabd339ddad5a"}
May 27 02:13:14.369621 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.369619    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"
May 27 02:13:14.369621 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.369628    2547 scope.go:117] "RemoveContainer" containerID="2abfe8f3629c70ba412e9e7a6ce185f672e58550119a4e38daac7de0a989241d"
May 27 02:13:14.377505 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.377471    2547 scope.go:117] "RemoveContainer" containerID="d5346cf3d8b1704449fc586ba5f5445a14245f617a90c2f8b10156b594685c0d"
May 27 02:13:14.384230 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.384210    2547 scope.go:117] "RemoveContainer" containerID="049f89621d1516a5e12ba41dd3f28b188559ff4425b26ff0f15529b352a2c95c"
May 27 02:13:14.390259 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.390230    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:13:14.391461 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.391444    2547 scope.go:117] "RemoveContainer" containerID="8d952271e8fbbf4808d4f23e9331635b9d9313acc5955f5b51a4c2590273a88f"
May 27 02:13:14.393939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.393915    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-87fc7675b-ck62h"]
May 27 02:13:14.398571 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.398553    2547 scope.go:117] "RemoveContainer" containerID="b7df2e69f5de40984cafc25b21c72f05e232bcf8bf3d4450233f6affcc64d3a2"
May 27 02:13:14.404909 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:14.404893    2547 scope.go:117] "RemoveContainer" containerID="5aa29a0db066385ee338827bc446be72855645ff1c5c9afaba2845e5f4428e69"
May 27 02:13:15.845727 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:15.845694    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" path="/var/lib/kubelet/pods/86e34236-3d37-4f9c-a36b-cc7c189211ac/volumes"
May 27 02:13:25.825640 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.825608    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:13:25.826159 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826136    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="registry"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826162    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="registry"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826180    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826188    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826197    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826206    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826220    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="offline"
May 27 02:13:25.826236 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826228    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="offline"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826246    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="offline"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826255    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="offline"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826269    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="feast-apply"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826277    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="feast-apply"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826293    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826301    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826313    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826320    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826332    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="feast-apply"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826340    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="feast-apply"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826351    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="feast-init"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826360    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="feast-init"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826371    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="feast-init"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826379    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="feast-init"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826470    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826483    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="offline"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826497    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="online"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826507    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="offline"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826520    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="ui"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826532    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="86e34236-3d37-4f9c-a36b-cc7c189211ac" containerName="registry"
May 27 02:13:25.826564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.826544    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="779110a7-2605-47ef-b309-25b3a6b8283a" containerName="ui"
May 27 02:13:25.832015 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.831991    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:25.835318 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.835278    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 27 02:13:25.835438 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.835350    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-l5w24\""
May 27 02:13:25.836018 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.835979    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 27 02:13:25.836164 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.836058    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 27 02:13:25.836463 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.836436    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:13:25.875856 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.875825    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:13:25.879153 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.879132    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:13:25.886206 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.885909    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:13:25.921550 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.921522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:25.921678 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:25.921578    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvg9\" (UniqueName: \"kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.021990 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.021942    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvg9\" (UniqueName: \"kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.022162 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.022010    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6p6\" (UniqueName: \"kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6\") pod \"redis-854544c579-qhpjb\" (UID: \"124b4bce-3da4-48ec-a22d-466723725d1d\") " pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:13:26.022162 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.022040    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.022367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.022348    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.030479 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.030456    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvg9\" (UniqueName: \"kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9\") pod \"postgres-7c7656cc6d-jgfrb\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") " pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.122499 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.122420    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6p6\" (UniqueName: \"kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6\") pod \"redis-854544c579-qhpjb\" (UID: \"124b4bce-3da4-48ec-a22d-466723725d1d\") " pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:13:26.131396 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.131367    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6p6\" (UniqueName: \"kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6\") pod \"redis-854544c579-qhpjb\" (UID: \"124b4bce-3da4-48ec-a22d-466723725d1d\") " pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:13:26.147243 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.147224    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:13:26.189142 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.189114    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:13:26.292621 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.292588    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:13:26.296683 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:13:26.296437    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1ece61c_692c_49ad_828e_608eefb21967.slice/crio-e3711129a349fba75f25b5dc8768712b3f3233d8ce70344bdf65a91a0f80eeb5 WatchSource:0}: Error finding container e3711129a349fba75f25b5dc8768712b3f3233d8ce70344bdf65a91a0f80eeb5: Status 404 returned error can't find the container with id e3711129a349fba75f25b5dc8768712b3f3233d8ce70344bdf65a91a0f80eeb5
May 27 02:13:26.342710 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.342298    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:13:26.346631 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:13:26.346603    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod124b4bce_3da4_48ec_a22d_466723725d1d.slice/crio-a099983e9aa23aedcb07bd249ef719dcc1177939eef62d7d76e210095c532ecb WatchSource:0}: Error finding container a099983e9aa23aedcb07bd249ef719dcc1177939eef62d7d76e210095c532ecb: Status 404 returned error can't find the container with id a099983e9aa23aedcb07bd249ef719dcc1177939eef62d7d76e210095c532ecb
May 27 02:13:26.406534 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.406462    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-qhpjb" event={"ID":"124b4bce-3da4-48ec-a22d-466723725d1d","Type":"ContainerStarted","Data":"a099983e9aa23aedcb07bd249ef719dcc1177939eef62d7d76e210095c532ecb"}
May 27 02:13:26.407504 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:26.407481    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" event={"ID":"e1ece61c-692c-49ad-828e-608eefb21967","Type":"ContainerStarted","Data":"e3711129a349fba75f25b5dc8768712b3f3233d8ce70344bdf65a91a0f80eeb5"}
May 27 02:13:28.414864 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:28.414784    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-qhpjb" event={"ID":"124b4bce-3da4-48ec-a22d-466723725d1d","Type":"ContainerStarted","Data":"ac82be4583265ab7fd5c13afab4460727ac8a9b86c78f08c7a1aa2c0bc4ba740"}
May 27 02:13:28.429867 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:28.429817    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-qhpjb" podStartSLOduration=1.764074554 podStartE2EDuration="3.429802443s" podCreationTimestamp="2026-05-27 02:13:25 +0000 UTC" firstStartedPulling="2026-05-27 02:13:26.348305648 +0000 UTC m=+843.143550050" lastFinishedPulling="2026-05-27 02:13:28.01403352 +0000 UTC m=+844.809277939" observedRunningTime="2026-05-27 02:13:28.429181524 +0000 UTC m=+845.224425952" watchObservedRunningTime="2026-05-27 02:13:28.429802443 +0000 UTC m=+845.225046867"
May 27 02:13:33.429614 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:33.429576    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" event={"ID":"e1ece61c-692c-49ad-828e-608eefb21967","Type":"ContainerStarted","Data":"6f35d12a9a1bb1e58f8259d58e2144be16cfd1c9e32126d3879fe8a2d90cecdf"}
May 27 02:13:33.448341 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:33.448296    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" podStartSLOduration=2.247968092 podStartE2EDuration="8.448281858s" podCreationTimestamp="2026-05-27 02:13:25 +0000 UTC" firstStartedPulling="2026-05-27 02:13:26.298490064 +0000 UTC m=+843.093734468" lastFinishedPulling="2026-05-27 02:13:32.49880383 +0000 UTC m=+849.294048234" observedRunningTime="2026-05-27 02:13:33.446912438 +0000 UTC m=+850.242156864" watchObservedRunningTime="2026-05-27 02:13:33.448281858 +0000 UTC m=+850.243526283"
May 27 02:13:36.571488 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.571460    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:13:36.579743 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.579722    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.584930 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.584868    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 27 02:13:36.584930 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.584868    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 27 02:13:36.585228 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.585206    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 27 02:13:36.585323 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.585244    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 27 02:13:36.586289 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.586265    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-45hqk\""
May 27 02:13:36.593049 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.593027    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:13:36.713670 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.713639    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.713811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.713679    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.713811 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.713698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5bl\" (UniqueName: \"kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.713933 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.713828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.713933 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.713867    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815035 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815007    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815035 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815035    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815237 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815101    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815237 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815121    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815237 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815144    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5bl\" (UniqueName: \"kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.815583 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.815552    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.817452 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.817423    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.817628 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.817607    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.817666 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.817607    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.823298 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.823256    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5bl\" (UniqueName: \"kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl\") pod \"feast-credit-scoring-66cd9c755c-v5jm9\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") " pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:36.889033 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:36.889000    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:37.020684 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:37.020662    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:13:37.023143 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:13:37.023115    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4d61df_ff8f_4ee2_9dc6_a42878f8855e.slice/crio-d80c487f0320717769c1d14fab55e54b54f2369458534cba5cd1cc7e75472569 WatchSource:0}: Error finding container d80c487f0320717769c1d14fab55e54b54f2369458534cba5cd1cc7e75472569: Status 404 returned error can't find the container with id d80c487f0320717769c1d14fab55e54b54f2369458534cba5cd1cc7e75472569
May 27 02:13:37.443663 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:37.443580    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"5061575dbb00c9ba7a9bf0b261a9d79b719384c2a094ec6f52ef3952f663197c"}
May 27 02:13:37.443663 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:37.443618    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"d80c487f0320717769c1d14fab55e54b54f2369458534cba5cd1cc7e75472569"}
May 27 02:13:38.448149 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:38.448078    2547 generic.go:358] "Generic (PLEG): container finished" podID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerID="5061575dbb00c9ba7a9bf0b261a9d79b719384c2a094ec6f52ef3952f663197c" exitCode=0
May 27 02:13:38.448454 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:38.448155    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"5061575dbb00c9ba7a9bf0b261a9d79b719384c2a094ec6f52ef3952f663197c"}
May 27 02:13:39.453418 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:39.453383    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"6b340fb98e08436fb3447e3d666700096e89ffe3da04dfe72446bc0aab742628"}
May 27 02:13:45.473717 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:45.473678    2547 generic.go:358] "Generic (PLEG): container finished" podID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerID="6b340fb98e08436fb3447e3d666700096e89ffe3da04dfe72446bc0aab742628" exitCode=0
May 27 02:13:45.474127 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:45.473756    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"6b340fb98e08436fb3447e3d666700096e89ffe3da04dfe72446bc0aab742628"}
May 27 02:13:46.480735 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.480703    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"6d66463ed24a51e88830ea8cc9ba9c5a716587f7666c789070908312f771c367"}
May 27 02:13:46.481238 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.480749    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"ef8c4bca85235c4252f5d399982f14ff2a4bd6e870fea5dcdb305c7b83ad8563"}
May 27 02:13:46.481238 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.480762    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerStarted","Data":"56674cd1832ddb84d44518cf2ad8d38e02ded6d87c54efe1b5fc423a99ade9f6"}
May 27 02:13:46.509295 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.508748    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podStartSLOduration=10.508730543 podStartE2EDuration="10.508730543s" podCreationTimestamp="2026-05-27 02:13:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:13:46.507606513 +0000 UTC m=+863.302850939" watchObservedRunningTime="2026-05-27 02:13:46.508730543 +0000 UTC m=+863.303974968"
May 27 02:13:46.889951 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.889838    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:46.889951 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.889912    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:46.889951 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:46.889943    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:48.889745 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.889704    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:48.890218 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.889765    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:48.890218 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.889781    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:48.891159 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.891119    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
May 27 02:13:48.891252 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.891154    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 27 02:13:48.891252 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:48.891163    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
May 27 02:13:51.890045 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:51.889999    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
May 27 02:13:51.890915 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:51.890889    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:51.891837 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:51.891818    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:51.895641 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:51.895612    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:52.511200 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:52.511171    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:54.889344 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:54.889304    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
May 27 02:13:57.890484 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:57.890451    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:13:57.891227 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:13:57.891205    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:14:23.784804 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:23.784773    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:14:23.786504 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:23.786482    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:14:23.791224 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:23.791201    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:14:23.792803 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:23.792783    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:14:57.560954 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.560920    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:14:57.561489 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.561286    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry" containerID="cri-o://56674cd1832ddb84d44518cf2ad8d38e02ded6d87c54efe1b5fc423a99ade9f6" gracePeriod=30
May 27 02:14:57.561489 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.561350    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online" containerID="cri-o://ef8c4bca85235c4252f5d399982f14ff2a4bd6e870fea5dcdb305c7b83ad8563" gracePeriod=30
May 27 02:14:57.561489 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.561361    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="offline" containerID="cri-o://6d66463ed24a51e88830ea8cc9ba9c5a716587f7666c789070908312f771c367" gracePeriod=30
May 27 02:14:57.579764 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.579733    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:14:57.579931 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.579914    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" podUID="e1ece61c-692c-49ad-828e-608eefb21967" containerName="postgres" containerID="cri-o://6f35d12a9a1bb1e58f8259d58e2144be16cfd1c9e32126d3879fe8a2d90cecdf" gracePeriod=30
May 27 02:14:57.588121 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.588095    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:14:57.588306 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.588269    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-qhpjb" podUID="124b4bce-3da4-48ec-a22d-466723725d1d" containerName="redis" containerID="cri-o://ac82be4583265ab7fd5c13afab4460727ac8a9b86c78f08c7a1aa2c0bc4ba740" gracePeriod=30
May 27 02:14:57.715170 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.715140    2547 generic.go:358] "Generic (PLEG): container finished" podID="124b4bce-3da4-48ec-a22d-466723725d1d" containerID="ac82be4583265ab7fd5c13afab4460727ac8a9b86c78f08c7a1aa2c0bc4ba740" exitCode=0
May 27 02:14:57.715318 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.715226    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-qhpjb" event={"ID":"124b4bce-3da4-48ec-a22d-466723725d1d","Type":"ContainerDied","Data":"ac82be4583265ab7fd5c13afab4460727ac8a9b86c78f08c7a1aa2c0bc4ba740"}
May 27 02:14:57.716690 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.716660    2547 generic.go:358] "Generic (PLEG): container finished" podID="e1ece61c-692c-49ad-828e-608eefb21967" containerID="6f35d12a9a1bb1e58f8259d58e2144be16cfd1c9e32126d3879fe8a2d90cecdf" exitCode=0
May 27 02:14:57.716807 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.716732    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" event={"ID":"e1ece61c-692c-49ad-828e-608eefb21967","Type":"ContainerDied","Data":"6f35d12a9a1bb1e58f8259d58e2144be16cfd1c9e32126d3879fe8a2d90cecdf"}
May 27 02:14:57.842453 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.842433    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:14:57.845931 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.845914    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:14:57.870899 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.870879    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata\") pod \"e1ece61c-692c-49ad-828e-608eefb21967\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") "
May 27 02:14:57.871023 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.870927    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqvg9\" (UniqueName: \"kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9\") pod \"e1ece61c-692c-49ad-828e-608eefb21967\" (UID: \"e1ece61c-692c-49ad-828e-608eefb21967\") "
May 27 02:14:57.873362 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.873328    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9" (OuterVolumeSpecName: "kube-api-access-hqvg9") pod "e1ece61c-692c-49ad-828e-608eefb21967" (UID: "e1ece61c-692c-49ad-828e-608eefb21967"). InnerVolumeSpecName "kube-api-access-hqvg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:14:57.910330 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.910296    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "e1ece61c-692c-49ad-828e-608eefb21967" (UID: "e1ece61c-692c-49ad-828e-608eefb21967"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:14:57.971664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.971634    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w6p6\" (UniqueName: \"kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6\") pod \"124b4bce-3da4-48ec-a22d-466723725d1d\" (UID: \"124b4bce-3da4-48ec-a22d-466723725d1d\") "
May 27 02:14:57.971810 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.971767    2547 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e1ece61c-692c-49ad-828e-608eefb21967-postgresdata\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:14:57.971810 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.971780    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqvg9\" (UniqueName: \"kubernetes.io/projected/e1ece61c-692c-49ad-828e-608eefb21967-kube-api-access-hqvg9\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:14:57.973763 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:57.973726    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6" (OuterVolumeSpecName: "kube-api-access-7w6p6") pod "124b4bce-3da4-48ec-a22d-466723725d1d" (UID: "124b4bce-3da4-48ec-a22d-466723725d1d"). InnerVolumeSpecName "kube-api-access-7w6p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:14:58.073128 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.073087    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w6p6\" (UniqueName: \"kubernetes.io/projected/124b4bce-3da4-48ec-a22d-466723725d1d-kube-api-access-7w6p6\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:14:58.720759 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.720731    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb"
May 27 02:14:58.721109 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.720750    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-jgfrb" event={"ID":"e1ece61c-692c-49ad-828e-608eefb21967","Type":"ContainerDied","Data":"e3711129a349fba75f25b5dc8768712b3f3233d8ce70344bdf65a91a0f80eeb5"}
May 27 02:14:58.721109 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.720796    2547 scope.go:117] "RemoveContainer" containerID="6f35d12a9a1bb1e58f8259d58e2144be16cfd1c9e32126d3879fe8a2d90cecdf"
May 27 02:14:58.722050 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.722032    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-qhpjb"
May 27 02:14:58.722153 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.722048    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-qhpjb" event={"ID":"124b4bce-3da4-48ec-a22d-466723725d1d","Type":"ContainerDied","Data":"a099983e9aa23aedcb07bd249ef719dcc1177939eef62d7d76e210095c532ecb"}
May 27 02:14:58.725006 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.724976    2547 generic.go:358] "Generic (PLEG): container finished" podID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerID="ef8c4bca85235c4252f5d399982f14ff2a4bd6e870fea5dcdb305c7b83ad8563" exitCode=0
May 27 02:14:58.725087 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.724986    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"ef8c4bca85235c4252f5d399982f14ff2a4bd6e870fea5dcdb305c7b83ad8563"}
May 27 02:14:58.729407 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.729382    2547 scope.go:117] "RemoveContainer" containerID="ac82be4583265ab7fd5c13afab4460727ac8a9b86c78f08c7a1aa2c0bc4ba740"
May 27 02:14:58.746415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.746394    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:14:58.749782 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.749749    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-qhpjb"]
May 27 02:14:58.760532 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.760512    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:14:58.764004 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:58.763981    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-jgfrb"]
May 27 02:14:59.845457 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:59.845428    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124b4bce-3da4-48ec-a22d-466723725d1d" path="/var/lib/kubelet/pods/124b4bce-3da4-48ec-a22d-466723725d1d/volumes"
May 27 02:14:59.846734 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:14:59.845749    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ece61c-692c-49ad-828e-608eefb21967" path="/var/lib/kubelet/pods/e1ece61c-692c-49ad-828e-608eefb21967/volumes"
May 27 02:15:02.509135 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:02.509090    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 27 02:15:12.508437 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:12.508391    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 27 02:15:22.508804 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:22.508757    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 27 02:15:22.509197 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:22.508902    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:15:27.813454 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:27.813418    2547 generic.go:358] "Generic (PLEG): container finished" podID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerID="6d66463ed24a51e88830ea8cc9ba9c5a716587f7666c789070908312f771c367" exitCode=137
May 27 02:15:27.813454 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:27.813448    2547 generic.go:358] "Generic (PLEG): container finished" podID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerID="56674cd1832ddb84d44518cf2ad8d38e02ded6d87c54efe1b5fc423a99ade9f6" exitCode=137
May 27 02:15:27.813834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:27.813491    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"6d66463ed24a51e88830ea8cc9ba9c5a716587f7666c789070908312f771c367"}
May 27 02:15:27.813834 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:27.813533    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"56674cd1832ddb84d44518cf2ad8d38e02ded6d87c54efe1b5fc423a99ade9f6"}
May 27 02:15:27.891050 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:27.890978    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
May 27 02:15:28.208034 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.208011    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:15:28.293825 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.293795    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm5bl\" (UniqueName: \"kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl\") pod \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") "
May 27 02:15:28.293984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.293833    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls\") pod \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") "
May 27 02:15:28.293984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.293873    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls\") pod \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") "
May 27 02:15:28.293984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.293911    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls\") pod \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") "
May 27 02:15:28.293984 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.293946    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data\") pod \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\" (UID: \"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e\") "
May 27 02:15:28.296062 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.296029    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" (UID: "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:15:28.296062 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.296048    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" (UID: "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:15:28.296062 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.296058    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl" (OuterVolumeSpecName: "kube-api-access-nm5bl") pod "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" (UID: "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e"). InnerVolumeSpecName "kube-api-access-nm5bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:15:28.296290 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.296266    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls" (OuterVolumeSpecName: "online-tls") pod "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" (UID: "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:15:28.302353 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.302328    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data" (OuterVolumeSpecName: "feast-data") pod "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" (UID: "fa4d61df-ff8f-4ee2-9dc6-a42878f8855e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:15:28.395053 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.395018    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:15:28.395053 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.395051    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm5bl\" (UniqueName: \"kubernetes.io/projected/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-kube-api-access-nm5bl\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:15:28.395053 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.395064    2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-offline-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:15:28.395226 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.395073    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:15:28.395226 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.395080    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:15:28.821520 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.821487    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9" event={"ID":"fa4d61df-ff8f-4ee2-9dc6-a42878f8855e","Type":"ContainerDied","Data":"d80c487f0320717769c1d14fab55e54b54f2369458534cba5cd1cc7e75472569"}
May 27 02:15:28.821925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.821537    2547 scope.go:117] "RemoveContainer" containerID="6d66463ed24a51e88830ea8cc9ba9c5a716587f7666c789070908312f771c367"
May 27 02:15:28.821925 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.821557    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"
May 27 02:15:28.829799 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.829784    2547 scope.go:117] "RemoveContainer" containerID="ef8c4bca85235c4252f5d399982f14ff2a4bd6e870fea5dcdb305c7b83ad8563"
May 27 02:15:28.836684 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.836668    2547 scope.go:117] "RemoveContainer" containerID="56674cd1832ddb84d44518cf2ad8d38e02ded6d87c54efe1b5fc423a99ade9f6"
May 27 02:15:28.843412 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.843393    2547 scope.go:117] "RemoveContainer" containerID="6b340fb98e08436fb3447e3d666700096e89ffe3da04dfe72446bc0aab742628"
May 27 02:15:28.846289 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.846266    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:15:28.850775 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.850759    2547 scope.go:117] "RemoveContainer" containerID="5061575dbb00c9ba7a9bf0b261a9d79b719384c2a094ec6f52ef3952f663197c"
May 27 02:15:28.855339 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:28.855317    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-66cd9c755c-v5jm9"]
May 27 02:15:29.845409 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:15:29.845378    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" path="/var/lib/kubelet/pods/fa4d61df-ff8f-4ee2-9dc6-a42878f8855e/volumes"
May 27 02:17:02.967791 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.967748    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968072    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ece61c-692c-49ad-828e-608eefb21967" containerName="postgres"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968083    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ece61c-692c-49ad-828e-608eefb21967" containerName="postgres"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968094    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968100    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968107    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="offline"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968112    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="offline"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968120    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="feast-init"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968125    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="feast-init"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968140    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124b4bce-3da4-48ec-a22d-466723725d1d" containerName="redis"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968145    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="124b4bce-3da4-48ec-a22d-466723725d1d" containerName="redis"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968150    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="feast-apply"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968155    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="feast-apply"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968160    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968165    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968210    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="registry"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968221    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="124b4bce-3da4-48ec-a22d-466723725d1d" containerName="redis"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968227    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1ece61c-692c-49ad-828e-608eefb21967" containerName="postgres"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968234    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="online"
May 27 02:17:02.968415 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.968241    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4d61df-ff8f-4ee2-9dc6-a42878f8855e" containerName="offline"
May 27 02:17:02.970182 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.970162    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:17:02.972774 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.972750    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 27 02:17:02.973147 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.973129    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 27 02:17:02.973887 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.973869    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-bhklp\""
May 27 02:17:02.994120 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:02.994096    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:17:03.081568 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.081521    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4jv\" (UniqueName: \"kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv\") pod \"redis-854544c579-2vlm9\" (UID: \"96ac85f5-b81d-45c4-a5d7-66dd0ea43475\") " pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:17:03.182717 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.182680    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4jv\" (UniqueName: \"kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv\") pod \"redis-854544c579-2vlm9\" (UID: \"96ac85f5-b81d-45c4-a5d7-66dd0ea43475\") " pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:17:03.192426 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.192394    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4jv\" (UniqueName: \"kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv\") pod \"redis-854544c579-2vlm9\" (UID: \"96ac85f5-b81d-45c4-a5d7-66dd0ea43475\") " pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:17:03.290522 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.290442    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:17:03.413684 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.413656    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:17:03.416173 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:17:03.416140    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96ac85f5_b81d_45c4_a5d7_66dd0ea43475.slice/crio-7eeb9c4f289d63ef91fa2865e01dd65d1bd6e022224821edc8723525bcfb826d WatchSource:0}: Error finding container 7eeb9c4f289d63ef91fa2865e01dd65d1bd6e022224821edc8723525bcfb826d: Status 404 returned error can't find the container with id 7eeb9c4f289d63ef91fa2865e01dd65d1bd6e022224821edc8723525bcfb826d
May 27 02:17:03.417882 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:03.417862    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 02:17:04.088332 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:04.088254    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2vlm9" event={"ID":"96ac85f5-b81d-45c4-a5d7-66dd0ea43475","Type":"ContainerStarted","Data":"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"}
May 27 02:17:04.088332 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:04.088288    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2vlm9" event={"ID":"96ac85f5-b81d-45c4-a5d7-66dd0ea43475","Type":"ContainerStarted","Data":"7eeb9c4f289d63ef91fa2865e01dd65d1bd6e022224821edc8723525bcfb826d"}
May 27 02:17:04.108631 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:04.108582    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-2vlm9" podStartSLOduration=2.10856947 podStartE2EDuration="2.10856947s" podCreationTimestamp="2026-05-27 02:17:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:17:04.108553515 +0000 UTC m=+1060.903797940" watchObservedRunningTime="2026-05-27 02:17:04.10856947 +0000 UTC m=+1060.903813895"
May 27 02:17:08.408193 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.408160    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:17:08.410274 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.410257    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.412770 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.412743    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 27 02:17:08.418452 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.418430    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:17:08.522168 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.522133    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskzc\" (UniqueName: \"kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.522322 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.522195    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.622580 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.622533    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.622751 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.622606    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tskzc\" (UniqueName: \"kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.622921 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.622900    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.631410 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.631385    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskzc\" (UniqueName: \"kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc\") pod \"postgres-7c7656cc6d-ztdd8\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.720620 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.720586    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:17:08.846368 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:08.846344    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:17:08.848482 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:17:08.848452    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ab2bee_4d4e_40e2_ae22_db591dd3cd6b.slice/crio-5001aa1255db26e012caeb695c52273c950c1864d2175b81162b1436f8fb2904 WatchSource:0}: Error finding container 5001aa1255db26e012caeb695c52273c950c1864d2175b81162b1436f8fb2904: Status 404 returned error can't find the container with id 5001aa1255db26e012caeb695c52273c950c1864d2175b81162b1436f8fb2904
May 27 02:17:09.105638 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:09.105564    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" event={"ID":"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b","Type":"ContainerStarted","Data":"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"}
May 27 02:17:09.105638 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:09.105608    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" event={"ID":"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b","Type":"ContainerStarted","Data":"5001aa1255db26e012caeb695c52273c950c1864d2175b81162b1436f8fb2904"}
May 27 02:17:09.122335 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:09.122293    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" podStartSLOduration=1.122279469 podStartE2EDuration="1.122279469s" podCreationTimestamp="2026-05-27 02:17:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:17:09.120666179 +0000 UTC m=+1065.915910605" watchObservedRunningTime="2026-05-27 02:17:09.122279469 +0000 UTC m=+1065.917523894"
May 27 02:17:14.086582 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.086548    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:17:14.090290 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.090271    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.092877 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.092857    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 27 02:17:14.093049 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.093023    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 27 02:17:14.093114 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.093047    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 27 02:17:14.093272 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.093259    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-kslwm\""
May 27 02:17:14.100594 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.100569    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:17:14.266524 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.266492    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.266681 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.266552    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.266681 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.266630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.266681 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.266664    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hfj\" (UniqueName: \"kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.367278 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.367211    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.367278 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.367257    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.367427 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.367280    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.367427 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.367304    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hfj\" (UniqueName: \"kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.367658 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.367635    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.369754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.369729    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.369890 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.369870    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.374896 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.374873    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hfj\" (UniqueName: \"kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj\") pod \"feast-credit-scoring-555888c75f-7wrkw\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") " pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.399972 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.399942    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:14.550267 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:14.550242    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:17:14.552081 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:17:14.552052    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958c4a0c_343b_446f_ae68_d85e5f98bc36.slice/crio-4328ecedcfd612ee67aa36b4590bb0be44b5133701eb4fed5d9146ed738ee11f WatchSource:0}: Error finding container 4328ecedcfd612ee67aa36b4590bb0be44b5133701eb4fed5d9146ed738ee11f: Status 404 returned error can't find the container with id 4328ecedcfd612ee67aa36b4590bb0be44b5133701eb4fed5d9146ed738ee11f
May 27 02:17:15.124531 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:15.124492    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerStarted","Data":"041db913e2935dfe7d6ca8aff1ea00bd36f6ae7eb9e90866b82323bec3876beb"}
May 27 02:17:15.124531 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:15.124531    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerStarted","Data":"4328ecedcfd612ee67aa36b4590bb0be44b5133701eb4fed5d9146ed738ee11f"}
May 27 02:17:16.128874 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:16.128838    2547 generic.go:358] "Generic (PLEG): container finished" podID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerID="041db913e2935dfe7d6ca8aff1ea00bd36f6ae7eb9e90866b82323bec3876beb" exitCode=0
May 27 02:17:16.129254 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:16.128923    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerDied","Data":"041db913e2935dfe7d6ca8aff1ea00bd36f6ae7eb9e90866b82323bec3876beb"}
May 27 02:17:17.133899 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:17.133865    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerStarted","Data":"ddfc9e4eca94dcf2ef2161cafea8a7eac19fbbc649c17c4e19c6d3c768bfe024"}
May 27 02:17:23.152789 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:23.152762    2547 generic.go:358] "Generic (PLEG): container finished" podID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerID="ddfc9e4eca94dcf2ef2161cafea8a7eac19fbbc649c17c4e19c6d3c768bfe024" exitCode=0
May 27 02:17:23.153161 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:23.152842    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerDied","Data":"ddfc9e4eca94dcf2ef2161cafea8a7eac19fbbc649c17c4e19c6d3c768bfe024"}
May 27 02:17:24.158770 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:24.158736    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerStarted","Data":"b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec"}
May 27 02:17:24.158770 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:24.158777    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerStarted","Data":"763851233d31ae95bb951ae18825e7dcb69d29d7e3221691192de03e0a26365a"}
May 27 02:17:24.183550 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:24.183501    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podStartSLOduration=10.183485649 podStartE2EDuration="10.183485649s" podCreationTimestamp="2026-05-27 02:17:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:17:24.181588669 +0000 UTC m=+1080.976833093" watchObservedRunningTime="2026-05-27 02:17:24.183485649 +0000 UTC m=+1080.978730076"
May 27 02:17:24.400079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:24.400047    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:24.400079 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:24.400089    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:26.400112 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:26.400083    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:26.400112 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:26.400121    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:26.401696 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:26.401665    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
May 27 02:17:26.401841 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:26.401728    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
May 27 02:17:29.400384 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:29.400331    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
May 27 02:17:29.405593 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:29.405564    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:29.408979 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:29.408941    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:32.400673 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:32.400623    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
May 27 02:17:35.400936 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:35.400908    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:35.401564 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:35.401544    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:17:40.052026 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.051988    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:17:40.057580 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.057557    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.060104 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.060084    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 27 02:17:40.060104 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.060097    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-msr6t\""
May 27 02:17:40.060250 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.060136    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 27 02:17:40.060250 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.060085    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 27 02:17:40.067991 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.067970    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:17:40.074710 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.074688    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.074812 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.074725    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.074812 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.074752    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.074895 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.074847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjl6\" (UniqueName: \"kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.175799 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.175769    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.175799 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.175807    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.176018 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.175825    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.176018 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.175856    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjl6\" (UniqueName: \"kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.176018 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:17:40.175979    2547 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
May 27 02:17:40.176130 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:17:40.176057    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls podName:f80ad9da-f121-436a-8eb2-c392cd499986 nodeName:}" failed. No retries permitted until 2026-05-27 02:17:40.676039372 +0000 UTC m=+1097.471283779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls") pod "feast-driver-ranking-5f77b4cc6-8lcm8" (UID: "f80ad9da-f121-436a-8eb2-c392cd499986") : secret "feast-driver-ranking-registry-tls" not found
May 27 02:17:40.176325 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.176295    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.178316 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.178296    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.186748 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.186726    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjl6\" (UniqueName: \"kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.679522 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.679481    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.681889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.681869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") pod \"feast-driver-ranking-5f77b4cc6-8lcm8\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") " pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:40.967397 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:40.967315    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:41.095932 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:41.095903    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:17:41.098329 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:17:41.098295    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80ad9da_f121_436a_8eb2_c392cd499986.slice/crio-974d9f9b47793677dcfba4db09fc3ed13aeb052dbcbfda0c5b92369abbe0663f WatchSource:0}: Error finding container 974d9f9b47793677dcfba4db09fc3ed13aeb052dbcbfda0c5b92369abbe0663f: Status 404 returned error can't find the container with id 974d9f9b47793677dcfba4db09fc3ed13aeb052dbcbfda0c5b92369abbe0663f
May 27 02:17:41.214532 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:41.214501    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerStarted","Data":"cad18c73cfcbab85d31a4894614add5d256746c7e3c9c9a450958fd6f2e82b53"}
May 27 02:17:41.214532 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:41.214541    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerStarted","Data":"974d9f9b47793677dcfba4db09fc3ed13aeb052dbcbfda0c5b92369abbe0663f"}
May 27 02:17:46.231638 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:46.231606    2547 generic.go:358] "Generic (PLEG): container finished" podID="f80ad9da-f121-436a-8eb2-c392cd499986" containerID="cad18c73cfcbab85d31a4894614add5d256746c7e3c9c9a450958fd6f2e82b53" exitCode=0
May 27 02:17:46.232089 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:46.231680    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerDied","Data":"cad18c73cfcbab85d31a4894614add5d256746c7e3c9c9a450958fd6f2e82b53"}
May 27 02:17:47.235843 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:47.235807    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerStarted","Data":"216fdd78313b55943f8de70e0aeb5d7af06f6f385955ccb63ed74997dbf70e9d"}
May 27 02:17:53.256225 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:53.256157    2547 generic.go:358] "Generic (PLEG): container finished" podID="f80ad9da-f121-436a-8eb2-c392cd499986" containerID="216fdd78313b55943f8de70e0aeb5d7af06f6f385955ccb63ed74997dbf70e9d" exitCode=0
May 27 02:17:53.256518 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:53.256227    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerDied","Data":"216fdd78313b55943f8de70e0aeb5d7af06f6f385955ccb63ed74997dbf70e9d"}
May 27 02:17:54.262216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:54.262175    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerStarted","Data":"3563fac0bc8e055ba307477d7ba57dc2c3ce3f9d4aa02340253eacb0ca11bc16"}
May 27 02:17:54.262216 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:54.262218    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerStarted","Data":"622f32f66213ea207123102b0adb73fd4160c93418466940e0615568e8c5a661"}
May 27 02:17:54.287239 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:54.287177    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podStartSLOduration=14.287158483 podStartE2EDuration="14.287158483s" podCreationTimestamp="2026-05-27 02:17:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:17:54.284023442 +0000 UTC m=+1111.079267868" watchObservedRunningTime="2026-05-27 02:17:54.287158483 +0000 UTC m=+1111.082402909"
May 27 02:17:55.968115 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:55.968081    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:55.968115 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:55.968123    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:55.969679 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:55.969646    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 27 02:17:55.969784 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:55.969677    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 27 02:17:58.968589 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:58.968544    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 27 02:17:59.320215 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:59.320142    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:59.320597 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:59.320576    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:17:59.323482 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:17:59.323449    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:18:00.967708 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:18:00.967664    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:18:01.967823 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:18:01.967782    2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 27 02:18:04.968546 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:18:04.968516    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:18:04.969109 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:18:04.969088    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:19:18.198868 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.198833    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:19:18.199352 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.199079    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" podUID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" containerName="manager" containerID="cri-o://027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404" gracePeriod=10
May 27 02:19:18.447030 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.447007    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:19:18.527072 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.527043    2547 generic.go:358] "Generic (PLEG): container finished" podID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" containerID="027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404" exitCode=0
May 27 02:19:18.527251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.527091    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" event={"ID":"85686ef5-d0f0-48fd-b7ab-8c260f44a65f","Type":"ContainerDied","Data":"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"}
May 27 02:19:18.527251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.527112    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"
May 27 02:19:18.527251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.527144    2547 scope.go:117] "RemoveContainer" containerID="027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"
May 27 02:19:18.527251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.527132    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf" event={"ID":"85686ef5-d0f0-48fd-b7ab-8c260f44a65f","Type":"ContainerDied","Data":"520309cb4cc16baa48f7edaa61b4e4a967ed71b942b84aa7195d135369a83c0e"}
May 27 02:19:18.537578 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.537560    2547 scope.go:117] "RemoveContainer" containerID="027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"
May 27 02:19:18.537862 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:19:18.537837    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404\": container with ID starting with 027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404 not found: ID does not exist" containerID="027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"
May 27 02:19:18.537983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.537862    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:19:18.537983 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.537867    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404"} err="failed to get container status \"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404\": rpc error: code = NotFound desc = could not find container \"027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404\": container with ID starting with 027a24be69a34359a1214d909cf5d412b5febb73855cf9cceafeb45f6b312404 not found: ID does not exist"
May 27 02:19:18.538182 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.538153    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry" containerID="cri-o://763851233d31ae95bb951ae18825e7dcb69d29d7e3221691192de03e0a26365a" gracePeriod=30
May 27 02:19:18.538288 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.538181    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online" containerID="cri-o://b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec" gracePeriod=30
May 27 02:19:18.545249 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.545223    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:19:18.545502 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.545481    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry" containerID="cri-o://622f32f66213ea207123102b0adb73fd4160c93418466940e0615568e8c5a661" gracePeriod=30
May 27 02:19:18.545576 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.545524    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online" containerID="cri-o://3563fac0bc8e055ba307477d7ba57dc2c3ce3f9d4aa02340253eacb0ca11bc16" gracePeriod=30
May 27 02:19:18.548507 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.548490    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn6kk\" (UniqueName: \"kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk\") pod \"85686ef5-d0f0-48fd-b7ab-8c260f44a65f\" (UID: \"85686ef5-d0f0-48fd-b7ab-8c260f44a65f\") "
May 27 02:19:18.550391 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.550369    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk" (OuterVolumeSpecName: "kube-api-access-xn6kk") pod "85686ef5-d0f0-48fd-b7ab-8c260f44a65f" (UID: "85686ef5-d0f0-48fd-b7ab-8c260f44a65f"). InnerVolumeSpecName "kube-api-access-xn6kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:19:18.649160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.649137    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn6kk\" (UniqueName: \"kubernetes.io/projected/85686ef5-d0f0-48fd-b7ab-8c260f44a65f-kube-api-access-xn6kk\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:18.848640 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.848612    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:19:18.852276 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:18.852253    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-67dd5f7456-pljhf"]
May 27 02:19:19.231184 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:19:19.231155    2547 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958c4a0c_343b_446f_ae68_d85e5f98bc36.slice/crio-b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec.scope\": RecentStats: unable to find data in memory cache]"
May 27 02:19:19.231486 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:19:19.231311    2547 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958c4a0c_343b_446f_ae68_d85e5f98bc36.slice/crio-b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec.scope\": RecentStats: unable to find data in memory cache]"
May 27 02:19:19.321638 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.321604    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 27 02:19:19.406258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.406223    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
May 27 02:19:19.532875 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.532788    2547 generic.go:358] "Generic (PLEG): container finished" podID="f80ad9da-f121-436a-8eb2-c392cd499986" containerID="3563fac0bc8e055ba307477d7ba57dc2c3ce3f9d4aa02340253eacb0ca11bc16" exitCode=0
May 27 02:19:19.533047 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.532865    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerDied","Data":"3563fac0bc8e055ba307477d7ba57dc2c3ce3f9d4aa02340253eacb0ca11bc16"}
May 27 02:19:19.534805 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.534777    2547 generic.go:358] "Generic (PLEG): container finished" podID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerID="b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec" exitCode=0
May 27 02:19:19.534922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.534850    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerDied","Data":"b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec"}
May 27 02:19:19.849803 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:19.849709    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" path="/var/lib/kubelet/pods/85686ef5-d0f0-48fd-b7ab-8c260f44a65f/volumes"
May 27 02:19:20.702042 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.702005    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:19:20.702404 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.702204    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" podUID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" containerName="postgres" containerID="cri-o://818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8" gracePeriod=30
May 27 02:19:20.706369 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.706345    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:19:20.706538 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.706518    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-2vlm9" podUID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" containerName="redis" containerID="cri-o://577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a" gracePeriod=30
May 27 02:19:20.965622 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.965602    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:19:20.968472 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:20.968454    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:19:21.067658 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.067629    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv4jv\" (UniqueName: \"kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv\") pod \"96ac85f5-b81d-45c4-a5d7-66dd0ea43475\" (UID: \"96ac85f5-b81d-45c4-a5d7-66dd0ea43475\") "
May 27 02:19:21.067809 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.067665    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tskzc\" (UniqueName: \"kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc\") pod \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") "
May 27 02:19:21.067809 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.067707    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata\") pod \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\" (UID: \"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b\") "
May 27 02:19:21.069849 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.069818    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc" (OuterVolumeSpecName: "kube-api-access-tskzc") pod "99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" (UID: "99ab2bee-4d4e-40e2-ae22-db591dd3cd6b"). InnerVolumeSpecName "kube-api-access-tskzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:19:21.069849 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.069834    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv" (OuterVolumeSpecName: "kube-api-access-mv4jv") pod "96ac85f5-b81d-45c4-a5d7-66dd0ea43475" (UID: "96ac85f5-b81d-45c4-a5d7-66dd0ea43475"). InnerVolumeSpecName "kube-api-access-mv4jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:19:21.097375 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.097332    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" (UID: "99ab2bee-4d4e-40e2-ae22-db591dd3cd6b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:19:21.168847 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.168821    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv4jv\" (UniqueName: \"kubernetes.io/projected/96ac85f5-b81d-45c4-a5d7-66dd0ea43475-kube-api-access-mv4jv\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:21.168847 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.168847    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tskzc\" (UniqueName: \"kubernetes.io/projected/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-kube-api-access-tskzc\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:21.169027 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.168857    2547 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b-postgresdata\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:21.543688 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.543654    2547 generic.go:358] "Generic (PLEG): container finished" podID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" containerID="818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8" exitCode=0
May 27 02:19:21.543859 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.543699    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"
May 27 02:19:21.543859 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.543736    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" event={"ID":"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b","Type":"ContainerDied","Data":"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"}
May 27 02:19:21.543859 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.543773    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-ztdd8" event={"ID":"99ab2bee-4d4e-40e2-ae22-db591dd3cd6b","Type":"ContainerDied","Data":"5001aa1255db26e012caeb695c52273c950c1864d2175b81162b1436f8fb2904"}
May 27 02:19:21.543859 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.543793    2547 scope.go:117] "RemoveContainer" containerID="818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"
May 27 02:19:21.544828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.544806    2547 generic.go:358] "Generic (PLEG): container finished" podID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" containerID="577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a" exitCode=0
May 27 02:19:21.544940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.544854    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2vlm9"
May 27 02:19:21.544940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.544873    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2vlm9" event={"ID":"96ac85f5-b81d-45c4-a5d7-66dd0ea43475","Type":"ContainerDied","Data":"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"}
May 27 02:19:21.544940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.544897    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2vlm9" event={"ID":"96ac85f5-b81d-45c4-a5d7-66dd0ea43475","Type":"ContainerDied","Data":"7eeb9c4f289d63ef91fa2865e01dd65d1bd6e022224821edc8723525bcfb826d"}
May 27 02:19:21.551625 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.551607    2547 scope.go:117] "RemoveContainer" containerID="818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"
May 27 02:19:21.551857 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:19:21.551840    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8\": container with ID starting with 818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8 not found: ID does not exist" containerID="818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"
May 27 02:19:21.551905 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.551865    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8"} err="failed to get container status \"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8\": rpc error: code = NotFound desc = could not find container \"818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8\": container with ID starting with 818018c72176630633fac3afa3d66e81a8e64b8f46657d432b0011883884c5b8 not found: ID does not exist"
May 27 02:19:21.551905 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.551882    2547 scope.go:117] "RemoveContainer" containerID="577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"
May 27 02:19:21.559358 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.559340    2547 scope.go:117] "RemoveContainer" containerID="577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"
May 27 02:19:21.559603 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:19:21.559585    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a\": container with ID starting with 577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a not found: ID does not exist" containerID="577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"
May 27 02:19:21.559658 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.559613    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a"} err="failed to get container status \"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a\": rpc error: code = NotFound desc = could not find container \"577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a\": container with ID starting with 577a933e956b6c3e76149e04e467e5ce6c1ddc33a52cc5423df81a91b5546a8a not found: ID does not exist"
May 27 02:19:21.568133 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.568112    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:19:21.571309 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.571287    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-ztdd8"]
May 27 02:19:21.580947 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.580927    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:19:21.585262 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.585242    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2vlm9"]
May 27 02:19:21.846245 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.846171    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" path="/var/lib/kubelet/pods/96ac85f5-b81d-45c4-a5d7-66dd0ea43475/volumes"
May 27 02:19:21.846562 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:21.846508    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" path="/var/lib/kubelet/pods/99ab2bee-4d4e-40e2-ae22-db591dd3cd6b/volumes"
May 27 02:19:23.809471 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:23.809446    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:19:23.811599 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:23.811577    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:19:23.814922 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:23.814904    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:19:23.817041 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:23.817024    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:19:29.320939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:29.320901    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 27 02:19:29.406815 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:29.406771    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
May 27 02:19:39.320595 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:39.320555    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 27 02:19:39.321030 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:39.320658    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:19:39.406380 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:39.406344    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
May 27 02:19:39.406505 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:39.406444    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:19:48.628364 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:48.628337    2547 generic.go:358] "Generic (PLEG): container finished" podID="f80ad9da-f121-436a-8eb2-c392cd499986" containerID="622f32f66213ea207123102b0adb73fd4160c93418466940e0615568e8c5a661" exitCode=137
May 27 02:19:48.628623 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:48.628415    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerDied","Data":"622f32f66213ea207123102b0adb73fd4160c93418466940e0615568e8c5a661"}
May 27 02:19:48.630425 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:48.630407    2547 generic.go:358] "Generic (PLEG): container finished" podID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerID="763851233d31ae95bb951ae18825e7dcb69d29d7e3221691192de03e0a26365a" exitCode=137
May 27 02:19:48.630510 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:48.630475    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerDied","Data":"763851233d31ae95bb951ae18825e7dcb69d29d7e3221691192de03e0a26365a"}
May 27 02:19:49.205219 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.205197    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:19:49.207932 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.207917    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:19:49.373585 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373513    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data\") pod \"958c4a0c-343b-446f-ae68-d85e5f98bc36\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") "
May 27 02:19:49.373585 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373577    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9hfj\" (UniqueName: \"kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj\") pod \"958c4a0c-343b-446f-ae68-d85e5f98bc36\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") "
May 27 02:19:49.373806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373603    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data\") pod \"f80ad9da-f121-436a-8eb2-c392cd499986\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") "
May 27 02:19:49.373806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373646    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls\") pod \"958c4a0c-343b-446f-ae68-d85e5f98bc36\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") "
May 27 02:19:49.373806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373664    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") pod \"f80ad9da-f121-436a-8eb2-c392cd499986\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") "
May 27 02:19:49.373806 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373750    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccjl6\" (UniqueName: \"kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6\") pod \"f80ad9da-f121-436a-8eb2-c392cd499986\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") "
May 27 02:19:49.374041 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373819    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls\") pod \"f80ad9da-f121-436a-8eb2-c392cd499986\" (UID: \"f80ad9da-f121-436a-8eb2-c392cd499986\") "
May 27 02:19:49.374041 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.373851    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls\") pod \"958c4a0c-343b-446f-ae68-d85e5f98bc36\" (UID: \"958c4a0c-343b-446f-ae68-d85e5f98bc36\") "
May 27 02:19:49.374210 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.374183    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data" (OuterVolumeSpecName: "feast-data") pod "f80ad9da-f121-436a-8eb2-c392cd499986" (UID: "f80ad9da-f121-436a-8eb2-c392cd499986"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:19:49.376403 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376359    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6" (OuterVolumeSpecName: "kube-api-access-ccjl6") pod "f80ad9da-f121-436a-8eb2-c392cd499986" (UID: "f80ad9da-f121-436a-8eb2-c392cd499986"). InnerVolumeSpecName "kube-api-access-ccjl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:19:49.376403 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376361    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls" (OuterVolumeSpecName: "online-tls") pod "f80ad9da-f121-436a-8eb2-c392cd499986" (UID: "f80ad9da-f121-436a-8eb2-c392cd499986"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:19:49.376577 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376473    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "958c4a0c-343b-446f-ae68-d85e5f98bc36" (UID: "958c4a0c-343b-446f-ae68-d85e5f98bc36"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:19:49.376577 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376540    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f80ad9da-f121-436a-8eb2-c392cd499986" (UID: "f80ad9da-f121-436a-8eb2-c392cd499986"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:19:49.376675 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376619    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls" (OuterVolumeSpecName: "online-tls") pod "958c4a0c-343b-446f-ae68-d85e5f98bc36" (UID: "958c4a0c-343b-446f-ae68-d85e5f98bc36"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 02:19:49.376675 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.376627    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj" (OuterVolumeSpecName: "kube-api-access-j9hfj") pod "958c4a0c-343b-446f-ae68-d85e5f98bc36" (UID: "958c4a0c-343b-446f-ae68-d85e5f98bc36"). InnerVolumeSpecName "kube-api-access-j9hfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:19:49.382700 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.382680    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data" (OuterVolumeSpecName: "feast-data") pod "958c4a0c-343b-446f-ae68-d85e5f98bc36" (UID: "958c4a0c-343b-446f-ae68-d85e5f98bc36"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:19:49.474828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474806    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474828 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474827    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-registry-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474838    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccjl6\" (UniqueName: \"kubernetes.io/projected/f80ad9da-f121-436a-8eb2-c392cd499986-kube-api-access-ccjl6\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474847    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f80ad9da-f121-436a-8eb2-c392cd499986-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474856    2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/958c4a0c-343b-446f-ae68-d85e5f98bc36-online-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474864    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/958c4a0c-343b-446f-ae68-d85e5f98bc36-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474873    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9hfj\" (UniqueName: \"kubernetes.io/projected/958c4a0c-343b-446f-ae68-d85e5f98bc36-kube-api-access-j9hfj\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.474939 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.474881    2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f80ad9da-f121-436a-8eb2-c392cd499986-feast-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:19:49.635003 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.634928    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"
May 27 02:19:49.635330 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.634926    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8" event={"ID":"f80ad9da-f121-436a-8eb2-c392cd499986","Type":"ContainerDied","Data":"974d9f9b47793677dcfba4db09fc3ed13aeb052dbcbfda0c5b92369abbe0663f"}
May 27 02:19:49.635330 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.635042    2547 scope.go:117] "RemoveContainer" containerID="3563fac0bc8e055ba307477d7ba57dc2c3ce3f9d4aa02340253eacb0ca11bc16"
May 27 02:19:49.637072 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.637054    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"
May 27 02:19:49.637154 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.637054    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw" event={"ID":"958c4a0c-343b-446f-ae68-d85e5f98bc36","Type":"ContainerDied","Data":"4328ecedcfd612ee67aa36b4590bb0be44b5133701eb4fed5d9146ed738ee11f"}
May 27 02:19:49.642794 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.642775    2547 scope.go:117] "RemoveContainer" containerID="622f32f66213ea207123102b0adb73fd4160c93418466940e0615568e8c5a661"
May 27 02:19:49.650632 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.650614    2547 scope.go:117] "RemoveContainer" containerID="216fdd78313b55943f8de70e0aeb5d7af06f6f385955ccb63ed74997dbf70e9d"
May 27 02:19:49.657568 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.657546    2547 scope.go:117] "RemoveContainer" containerID="cad18c73cfcbab85d31a4894614add5d256746c7e3c9c9a450958fd6f2e82b53"
May 27 02:19:49.660889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.660867    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:19:49.665774 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.665750    2547 scope.go:117] "RemoveContainer" containerID="b6bbece20cae040ffbad324f9093c4f18f8740d5437aaac49904d73a96139aec"
May 27 02:19:49.665774 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.665760    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f77b4cc6-8lcm8"]
May 27 02:19:49.672291 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.672275    2547 scope.go:117] "RemoveContainer" containerID="763851233d31ae95bb951ae18825e7dcb69d29d7e3221691192de03e0a26365a"
May 27 02:19:49.678979 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.678948    2547 scope.go:117] "RemoveContainer" containerID="ddfc9e4eca94dcf2ef2161cafea8a7eac19fbbc649c17c4e19c6d3c768bfe024"
May 27 02:19:49.685535 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.685493    2547 scope.go:117] "RemoveContainer" containerID="041db913e2935dfe7d6ca8aff1ea00bd36f6ae7eb9e90866b82323bec3876beb"
May 27 02:19:49.687511 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.687492    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:19:49.695599 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.695582    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-555888c75f-7wrkw"]
May 27 02:19:49.845807 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.845786    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" path="/var/lib/kubelet/pods/958c4a0c-343b-446f-ae68-d85e5f98bc36/volumes"
May 27 02:19:49.846336 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:19:49.846322    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" path="/var/lib/kubelet/pods/f80ad9da-f121-436a-8eb2-c392cd499986/volumes"
May 27 02:24:23.831160 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:24:23.831129    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:24:23.833469 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:24:23.833445    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:24:23.836492 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:24:23.836467    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:24:23.838720 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:24:23.838702    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:29:23.851661 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:29:23.851633    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:29:23.853826 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:29:23.853795    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:29:23.856848 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:29:23.856829    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:29:23.859167 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:29:23.859149    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:30:11.372940 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.372907    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flxlx/must-gather-tqphr"]
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373212    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" containerName="postgres"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373223    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" containerName="postgres"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373231    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373237    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373246    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" containerName="manager"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373252    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" containerName="manager"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373257    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373262    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373268    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="feast-init"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373273    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="feast-init"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373281    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="feast-init"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373286    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="feast-init"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373292    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="feast-apply"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373297    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="feast-apply"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373331    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373336    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373342    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="feast-apply"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373347    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="feast-apply"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373360    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373365    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373374    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" containerName="redis"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373378    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" containerName="redis"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373424    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="registry"
May 27 02:30:11.373430 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373445    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="958c4a0c-343b-446f-ae68-d85e5f98bc36" containerName="online"
May 27 02:30:11.374258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373453    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="96ac85f5-b81d-45c4-a5d7-66dd0ea43475" containerName="redis"
May 27 02:30:11.374258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373459    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="registry"
May 27 02:30:11.374258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373465    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80ad9da-f121-436a-8eb2-c392cd499986" containerName="online"
May 27 02:30:11.374258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373471    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="99ab2bee-4d4e-40e2-ae22-db591dd3cd6b" containerName="postgres"
May 27 02:30:11.374258 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.373478    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="85686ef5-d0f0-48fd-b7ab-8c260f44a65f" containerName="manager"
May 27 02:30:11.375198 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.375183    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.377759 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.377722    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flxlx\"/\"openshift-service-ca.crt\""
May 27 02:30:11.377979 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.377822    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flxlx\"/\"kube-root-ca.crt\""
May 27 02:30:11.377979 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.377828    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flxlx\"/\"default-dockercfg-dj6h2\""
May 27 02:30:11.389306 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.389277    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flxlx/must-gather-tqphr"]
May 27 02:30:11.465653 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.465628    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.465763 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.465686    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.566734 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.566704    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.566825 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.566756    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.567044 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.567027    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.574694 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.574675    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2\") pod \"must-gather-tqphr\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") " pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.698164 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.698103    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:11.819871 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.819844    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flxlx/must-gather-tqphr"]
May 27 02:30:11.822812 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:30:11.822783    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaa2a4a3_a768_44f9_a2ae_b8ea4b2867e0.slice/crio-181b72af3cb81a9ce23eedc7e06a2e561cd4e54e817ee50cd35bcc3ccf23de76 WatchSource:0}: Error finding container 181b72af3cb81a9ce23eedc7e06a2e561cd4e54e817ee50cd35bcc3ccf23de76: Status 404 returned error can't find the container with id 181b72af3cb81a9ce23eedc7e06a2e561cd4e54e817ee50cd35bcc3ccf23de76
May 27 02:30:11.824928 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:11.824911    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 02:30:12.370027 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:12.369994    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flxlx/must-gather-tqphr" event={"ID":"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0","Type":"ContainerStarted","Data":"181b72af3cb81a9ce23eedc7e06a2e561cd4e54e817ee50cd35bcc3ccf23de76"}
May 27 02:30:18.389260 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:18.389219    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flxlx/must-gather-tqphr" event={"ID":"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0","Type":"ContainerStarted","Data":"bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7"}
May 27 02:30:18.389260 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:18.389262    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flxlx/must-gather-tqphr" event={"ID":"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0","Type":"ContainerStarted","Data":"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"}
May 27 02:30:18.404660 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:18.404611    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-flxlx/must-gather-tqphr" podStartSLOduration=1.409612347 podStartE2EDuration="7.404597779s" podCreationTimestamp="2026-05-27 02:30:11 +0000 UTC" firstStartedPulling="2026-05-27 02:30:11.825047659 +0000 UTC m=+1848.620292066" lastFinishedPulling="2026-05-27 02:30:17.820033087 +0000 UTC m=+1854.615277498" observedRunningTime="2026-05-27 02:30:18.4036678 +0000 UTC m=+1855.198912225" watchObservedRunningTime="2026-05-27 02:30:18.404597779 +0000 UTC m=+1855.199842219"
May 27 02:30:27.415012 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:27.414974    2547 generic.go:358] "Generic (PLEG): container finished" podID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerID="1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663" exitCode=0
May 27 02:30:27.415423 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:27.415034    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flxlx/must-gather-tqphr" event={"ID":"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0","Type":"ContainerDied","Data":"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"}
May 27 02:30:27.415423 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:27.415337    2547 scope.go:117] "RemoveContainer" containerID="1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"
May 27 02:30:28.250311 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:28.250280    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flxlx_must-gather-tqphr_caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0/gather/0.log"
May 27 02:30:31.148500 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:31.148452    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gqfqh_393c5786-4415-4880-ade9-da9b65508447/global-pull-secret-syncer/0.log"
May 27 02:30:31.292214 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:31.292186    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2xpff_b5401109-df12-4bda-b2ec-20e423fd2201/konnectivity-agent/0.log"
May 27 02:30:31.369419 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:31.369393    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-250.ec2.internal_6c725834ddadb524d8d4138c86d3aef9/haproxy/0.log"
May 27 02:30:33.561614 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.561580    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-flxlx/must-gather-tqphr"]
May 27 02:30:33.562443 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.561886    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-flxlx/must-gather-tqphr" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="copy" containerID="cri-o://bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7" gracePeriod=2
May 27 02:30:33.564011 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.563988    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-flxlx/must-gather-tqphr"]
May 27 02:30:33.564146 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.564118    2547 status_manager.go:895] "Failed to get status for pod" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" pod="openshift-must-gather-flxlx/must-gather-tqphr" err="pods \"must-gather-tqphr\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-flxlx\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object"
May 27 02:30:33.784365 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.784311    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flxlx_must-gather-tqphr_caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0/copy/0.log"
May 27 02:30:33.784664 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.784648    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:33.787481 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.787454    2547 status_manager.go:895] "Failed to get status for pod" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" pod="openshift-must-gather-flxlx/must-gather-tqphr" err="pods \"must-gather-tqphr\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-flxlx\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object"
May 27 02:30:33.844845 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.844784    2547 status_manager.go:895] "Failed to get status for pod" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" pod="openshift-must-gather-flxlx/must-gather-tqphr" err="pods \"must-gather-tqphr\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-flxlx\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object"
May 27 02:30:33.850180 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.850163    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2\") pod \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") "
May 27 02:30:33.850275 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.850234    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output\") pod \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\" (UID: \"caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0\") "
May 27 02:30:33.850528 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.850508    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" (UID: "caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 02:30:33.852168 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.852147    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2" (OuterVolumeSpecName: "kube-api-access-z4sm2") pod "caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" (UID: "caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0"). InnerVolumeSpecName "kube-api-access-z4sm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 02:30:33.951217 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.951192    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4sm2\" (UniqueName: \"kubernetes.io/projected/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-kube-api-access-z4sm2\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:30:33.951217 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:33.951215    2547 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0-must-gather-output\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
May 27 02:30:34.435208 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.435177    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-flxlx_must-gather-tqphr_caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0/copy/0.log"
May 27 02:30:34.435508 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.435480    2547 generic.go:358] "Generic (PLEG): container finished" podID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerID="bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7" exitCode=143
May 27 02:30:34.435576 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.435530    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flxlx/must-gather-tqphr"
May 27 02:30:34.435576 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.435556    2547 scope.go:117] "RemoveContainer" containerID="bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7"
May 27 02:30:34.445535 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.445441    2547 scope.go:117] "RemoveContainer" containerID="1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"
May 27 02:30:34.456481 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.456464    2547 scope.go:117] "RemoveContainer" containerID="bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7"
May 27 02:30:34.456729 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:30:34.456712    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7\": container with ID starting with bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7 not found: ID does not exist" containerID="bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7"
May 27 02:30:34.456790 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.456736    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7"} err="failed to get container status \"bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7\": rpc error: code = NotFound desc = could not find container \"bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7\": container with ID starting with bd6d573a3aa9dc34f689d78b9d8626299eadcd9aa64395a2df6e7cfd145892f7 not found: ID does not exist"
May 27 02:30:34.456790 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.456753    2547 scope.go:117] "RemoveContainer" containerID="1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"
May 27 02:30:34.457020 ip-10-0-128-250 kubenswrapper[2547]: E0527 02:30:34.456955    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663\": container with ID starting with 1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663 not found: ID does not exist" containerID="1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"
May 27 02:30:34.457020 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.456987    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663"} err="failed to get container status \"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663\": rpc error: code = NotFound desc = could not find container \"1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663\": container with ID starting with 1f34a2745097f59912320a2fbf6dd95e6a3308a612840fba86dd6298dc4bc663 not found: ID does not exist"
May 27 02:30:34.798874 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.798844    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4jjsk_dc5e21a6-99df-4da5-a356-1c41dbd452c5/kube-state-metrics/0.log"
May 27 02:30:34.818615 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.818595    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4jjsk_dc5e21a6-99df-4da5-a356-1c41dbd452c5/kube-rbac-proxy-main/0.log"
May 27 02:30:34.844813 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.844792    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4jjsk_dc5e21a6-99df-4da5-a356-1c41dbd452c5/kube-rbac-proxy-self/0.log"
May 27 02:30:34.878067 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.878043    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bdbfc5547-mvj6r_24f06f18-e3d0-4dd5-b1d1-83f62ed61353/metrics-server/0.log"
May 27 02:30:34.900090 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.900071    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-78874_1b7d5bf5-d81d-4fc3-a97a-ed1e6f75e107/monitoring-plugin/0.log"
May 27 02:30:34.927803 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.927785    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bqgz_ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2/node-exporter/0.log"
May 27 02:30:34.949056 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.949037    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bqgz_ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2/kube-rbac-proxy/0.log"
May 27 02:30:34.972023 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:34.972007    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8bqgz_ecc2adf8-92be-4f03-9fd0-f3ef4f6896e2/init-textfile/0.log"
May 27 02:30:35.155012 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.154922    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-p2s4f_338f5042-72db-4f6d-8b22-592a24f11131/kube-rbac-proxy-main/0.log"
May 27 02:30:35.176661 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.176633    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-p2s4f_338f5042-72db-4f6d-8b22-592a24f11131/kube-rbac-proxy-self/0.log"
May 27 02:30:35.198025 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.198004    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-p2s4f_338f5042-72db-4f6d-8b22-592a24f11131/openshift-state-metrics/0.log"
May 27 02:30:35.599896 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.599868    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97f9dccf-9zpj5_fafca018-6bab-495f-9f3b-a3a30a1f6190/telemeter-client/0.log"
May 27 02:30:35.632875 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.632854    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97f9dccf-9zpj5_fafca018-6bab-495f-9f3b-a3a30a1f6190/reload/0.log"
May 27 02:30:35.660241 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.660218    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d97f9dccf-9zpj5_fafca018-6bab-495f-9f3b-a3a30a1f6190/kube-rbac-proxy/0.log"
May 27 02:30:35.846378 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:35.846337    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" path="/var/lib/kubelet/pods/caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0/volumes"
May 27 02:30:37.157997 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.157949    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/2.log"
May 27 02:30:37.162955 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.162935    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-vjvz5_c06ce271-5849-45a8-a50d-8d4b0ec198b5/console-operator/3.log"
May 27 02:30:37.470110 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.470079    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c785c9bbc-j74dd_471d7e15-425d-4705-b96c-7dff83831681/console/0.log"
May 27 02:30:37.497660 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.497627    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-k67p7_eba16667-c3f5-4b85-b82d-2f031fc4c6fb/download-server/0.log"
May 27 02:30:37.633919 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.633872    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"]
May 27 02:30:37.634271 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634253    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="copy"
May 27 02:30:37.634367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634273    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="copy"
May 27 02:30:37.634367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634289    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="gather"
May 27 02:30:37.634367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634297    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="gather"
May 27 02:30:37.634518 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634387    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="gather"
May 27 02:30:37.634518 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.634399    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="caa2a4a3-a768-44f9-a2ae-b8ea4b2867e0" containerName="copy"
May 27 02:30:37.639926 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.639904    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.642889 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.642869    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n92xx\"/\"kube-root-ca.crt\""
May 27 02:30:37.643916 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.643855    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n92xx\"/\"default-dockercfg-f78xs\""
May 27 02:30:37.644118 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.643878    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n92xx\"/\"openshift-service-ca.crt\""
May 27 02:30:37.646443 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.646421    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"]
May 27 02:30:37.780768 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.780673    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-sys\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.780768 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.780734    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-proc\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.780994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.780769    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-podres\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.780994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.780792    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbntw\" (UniqueName: \"kubernetes.io/projected/dca7ff06-aeff-4eb7-920d-b9d37732902c-kube-api-access-jbntw\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.780994 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.780817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-lib-modules\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.874770 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.874741    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-w6fc9_d0946cc3-5359-4f27-981a-8efaf993f676/volume-data-source-validator/0.log"
May 27 02:30:37.882267 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882244    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-proc\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882344 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882285    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-podres\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882382 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882358    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-proc\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882417 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882387    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-podres\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882417 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882403    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbntw\" (UniqueName: \"kubernetes.io/projected/dca7ff06-aeff-4eb7-920d-b9d37732902c-kube-api-access-jbntw\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882485 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882433    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-lib-modules\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882520 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882492    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-sys\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882580 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882564    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-sys\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.882647 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.882630    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca7ff06-aeff-4eb7-920d-b9d37732902c-lib-modules\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.889644 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.889620    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbntw\" (UniqueName: \"kubernetes.io/projected/dca7ff06-aeff-4eb7-920d-b9d37732902c-kube-api-access-jbntw\") pod \"perf-node-gather-daemonset-lfnlx\" (UID: \"dca7ff06-aeff-4eb7-920d-b9d37732902c\") " pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:37.950701 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:37.950661    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:38.078527 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.078351    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"]
May 27 02:30:38.081014 ip-10-0-128-250 kubenswrapper[2547]: W0527 02:30:38.080986    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddca7ff06_aeff_4eb7_920d_b9d37732902c.slice/crio-de029723154a7f0f7414ea75fd95ff5eee7009056dd5abe2f81e0cb410e95fe6 WatchSource:0}: Error finding container de029723154a7f0f7414ea75fd95ff5eee7009056dd5abe2f81e0cb410e95fe6: Status 404 returned error can't find the container with id de029723154a7f0f7414ea75fd95ff5eee7009056dd5abe2f81e0cb410e95fe6
May 27 02:30:38.448640 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.448544    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx" event={"ID":"dca7ff06-aeff-4eb7-920d-b9d37732902c","Type":"ContainerStarted","Data":"70b786ec69897df5e837369b30bf371793e423220a32e64afdcf292632986259"}
May 27 02:30:38.448640 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.448587    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx" event={"ID":"dca7ff06-aeff-4eb7-920d-b9d37732902c","Type":"ContainerStarted","Data":"de029723154a7f0f7414ea75fd95ff5eee7009056dd5abe2f81e0cb410e95fe6"}
May 27 02:30:38.449060 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.448677    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:38.464981 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.464903    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx" podStartSLOduration=1.464891656 podStartE2EDuration="1.464891656s" podCreationTimestamp="2026-05-27 02:30:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 02:30:38.463028628 +0000 UTC m=+1875.258273072" watchObservedRunningTime="2026-05-27 02:30:38.464891656 +0000 UTC m=+1875.260136081"
May 27 02:30:38.551787 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.551758    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7pt9_b5751e0c-f5c3-4a46-b923-50fcc933aee6/dns/0.log"
May 27 02:30:38.570754 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.570728    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7pt9_b5751e0c-f5c3-4a46-b923-50fcc933aee6/kube-rbac-proxy/0.log"
May 27 02:30:38.630489 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:38.630460    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g2jbf_9914aa31-1af5-4a64-bb0b-8672c0df9c87/dns-node-resolver/0.log"
May 27 02:30:39.062854 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:39.062825    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xgxh_8ee79504-aff2-4ce6-b49a-fb19ddef6875/node-ca/0.log"
May 27 02:30:40.050693 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.050665    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-64q6v_5af96246-6bcb-407a-9ff7-06df15433650/serve-healthcheck-canary/0.log"
May 27 02:30:40.399882 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.399793    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-x2d48_fdbecc2b-8cdd-4daf-8845-f023c82dc567/insights-operator/0.log"
May 27 02:30:40.400082 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.399948    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-x2d48_fdbecc2b-8cdd-4daf-8845-f023c82dc567/insights-operator/1.log"
May 27 02:30:40.539533 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.539502    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shbxx_89da5e65-1b3b-4889-b4a4-3538b48cbebf/kube-rbac-proxy/0.log"
May 27 02:30:40.558024 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.558001    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shbxx_89da5e65-1b3b-4889-b4a4-3538b48cbebf/exporter/0.log"
May 27 02:30:40.576852 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:40.576829    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shbxx_89da5e65-1b3b-4889-b4a4-3538b48cbebf/extractor/0.log"
May 27 02:30:44.312800 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:44.312767    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lfmzh_55a391f3-cb81-4beb-bcc3-324bf1f1ea46/migrator/0.log"
May 27 02:30:44.333061 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:44.333032    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lfmzh_55a391f3-cb81-4beb-bcc3-324bf1f1ea46/graceful-termination/0.log"
May 27 02:30:44.460751 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:44.460720    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n92xx/perf-node-gather-daemonset-lfnlx"
May 27 02:30:45.357888 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.357862    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/kube-multus-additional-cni-plugins/0.log"
May 27 02:30:45.379364 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.379334    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/egress-router-binary-copy/0.log"
May 27 02:30:45.401398 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.401374    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/cni-plugins/0.log"
May 27 02:30:45.420774 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.420753    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/bond-cni-plugin/0.log"
May 27 02:30:45.444697 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.444674    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/routeoverride-cni/0.log"
May 27 02:30:45.463953 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.463934    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/whereabouts-cni-bincopy/0.log"
May 27 02:30:45.483612 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.483586    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kwkw_756ca5d4-a51b-4367-a490-1bab1da5b262/whereabouts-cni/0.log"
May 27 02:30:45.830518 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.830479    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nt54b_875315df-898b-4417-a252-25ee51f3477a/kube-multus/0.log"
May 27 02:30:45.851309 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.851281    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-59jjz_7a970a1a-c99e-4f0d-a29c-8d6e82e1387b/network-metrics-daemon/0.log"
May 27 02:30:45.872843 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:45.872821    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-59jjz_7a970a1a-c99e-4f0d-a29c-8d6e82e1387b/kube-rbac-proxy/0.log"
May 27 02:30:47.361474 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.361445    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-controller/0.log"
May 27 02:30:47.377368 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.377347    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/0.log"
May 27 02:30:47.385125 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.385107    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovn-acl-logging/1.log"
May 27 02:30:47.402417 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.402379    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/kube-rbac-proxy-node/0.log"
May 27 02:30:47.422251 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.422230    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/kube-rbac-proxy-ovn-metrics/0.log"
May 27 02:30:47.438172 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.438151    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/northd/0.log"
May 27 02:30:47.464367 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.464342    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/nbdb/0.log"
May 27 02:30:47.484869 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.484850    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/sbdb/0.log"
May 27 02:30:47.574660 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:47.574640    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpn4x_9ecb3b81-dd0a-4207-b325-55392c86c92f/ovnkube-controller/0.log"
May 27 02:30:48.517516 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:48.517493    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-lkv8h_247829da-939d-4ff1-b39e-5ea71f79003d/check-endpoints/0.log"
May 27 02:30:48.541224 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:48.541203    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dh7bl_f7eb2cd2-989f-48ca-9e66-b8501e782bc6/network-check-target-container/0.log"
May 27 02:30:49.376418 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:49.376391    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7rpq7_e9b2b5aa-902d-4f5f-9033-f818a0f2956e/iptables-alerter/0.log"
May 27 02:30:49.946119 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:49.946088    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-26rh2_b34de040-5a2e-4466-afc9-98b2e0cdf34c/tuned/0.log"
May 27 02:30:51.562848 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:51.562821    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-7vglg_d5756c2c-f2e1-464a-b593-bc6729d5954f/cluster-samples-operator/0.log"
May 27 02:30:51.577619 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:51.577596    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-7vglg_d5756c2c-f2e1-464a-b593-bc6729d5954f/cluster-samples-operator-watch/0.log"
May 27 02:30:53.134996 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:53.134952    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kpsr5_b9a48f6e-09b7-4b6c-a429-4ab8895087aa/csi-driver/0.log"
May 27 02:30:53.154187 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:53.154156    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kpsr5_b9a48f6e-09b7-4b6c-a429-4ab8895087aa/csi-node-driver-registrar/0.log"
May 27 02:30:53.172255 ip-10-0-128-250 kubenswrapper[2547]: I0527 02:30:53.172237    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kpsr5_b9a48f6e-09b7-4b6c-a429-4ab8895087aa/csi-liveness-probe/0.log"