May 26 06:54:14.830868 ip-10-0-133-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 06:54:14.830879 ip-10-0-133-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 06:54:14.830888 ip-10-0-133-78 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 06:54:14.831237 ip-10-0-133-78 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 06:54:25.000035 ip-10-0-133-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 06:54:25.000053 ip-10-0-133-78 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8d86725593ae4466a70715840808521d --
May 26 06:56:57.653677 ip-10-0-133-78 systemd[1]: Starting Kubernetes Kubelet...
May 26 06:56:58.193881 ip-10-0-133-78 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:58.193881 ip-10-0-133-78 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 06:56:58.193881 ip-10-0-133-78 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:58.193881 ip-10-0-133-78 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 06:56:58.193881 ip-10-0-133-78 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:56:58.196050 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.195972    2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 06:56:58.202251 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202227    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:58.202251 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202246    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:58.202251 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202250    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:58.202251 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202254    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:58.202251 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202257    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202261    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202264    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202268    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202271    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202274    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202276    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202279    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202283    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202285    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202288    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202290    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202293    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202295    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202298    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202301    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202303    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202306    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202311    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202314    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:58.202484 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202317    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202320    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202322    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202325    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202329    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202333    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202335    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202338    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202340    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202343    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202345    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202348    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202350    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202353    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202356    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202359    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202362    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202365    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202367    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:58.202967 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202370    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202372    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202375    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202377    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202380    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202382    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202385    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202387    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202390    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202405    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202408    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202411    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202414    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202417    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202420    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202422    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202425    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202429    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202433    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:58.203444 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202436    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202439    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202442    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202446    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202448    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202451    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202453    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202456    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202459    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202462    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202465    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202468    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202470    2552 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202473    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202476    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202478    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202482    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202485    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202487    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202490    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:58.203903 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202493    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202496    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202498    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202501    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202861    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202866    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202869    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202871    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202874    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202877    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202879    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202882    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202885    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202888    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202890    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202893    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202896    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202898    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202901    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202904    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:58.204421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202907    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202910    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202912    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202915    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202917    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202920    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202922    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202927    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202931    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202934    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202936    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202947    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202950    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202952    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202955    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202957    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202960    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202962    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202965    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:58.204911 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202968    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202971    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202974    2552 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202976    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202979    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202982    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202984    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202987    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202989    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202992    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202994    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.202997    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203000    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203002    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203005    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203008    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203010    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203013    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203015    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203018    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:58.205387 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203021    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203025    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203028    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203031    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203033    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203036    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203038    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203041    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203043    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203046    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203049    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203051    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203054    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203056    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203059    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203062    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203064    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203067    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203069    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:58.205891 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203072    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203074    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203077    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203079    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203082    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203084    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203087    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203089    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203093    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203095    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203098    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.203100    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203748    2552 flags.go:64] FLAG: --address="0.0.0.0"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203757    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203767    2552 flags.go:64] FLAG: --anonymous-auth="true"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203772    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203777    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203780    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203784    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203789    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203792    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 06:56:58.206352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203795    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203798    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203805    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203809    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203811    2552 flags.go:64] FLAG: --cgroup-root=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203814    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203817    2552 flags.go:64] FLAG: --client-ca-file=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203820    2552 flags.go:64] FLAG: --cloud-config=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203823    2552 flags.go:64] FLAG: --cloud-provider="external"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203826    2552 flags.go:64] FLAG: --cluster-dns="[]"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203830    2552 flags.go:64] FLAG: --cluster-domain=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203833    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203836    2552 flags.go:64] FLAG: --config-dir=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203839    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203842    2552 flags.go:64] FLAG: --container-log-max-files="5"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203846    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203849    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203852    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203855    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203858    2552 flags.go:64] FLAG: --contention-profiling="false"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203861    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203863    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203866    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203869    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203874    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 06:56:58.206873 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203876    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203879    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203882    2552 flags.go:64] FLAG: --enable-load-reader="false"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203886    2552 flags.go:64] FLAG: --enable-server="true"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203889    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203893    2552 flags.go:64] FLAG: --event-burst="100"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203896    2552 flags.go:64] FLAG: --event-qps="50"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203899    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203902    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203907    2552 flags.go:64] FLAG: --eviction-hard=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203912    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203915    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203918    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203921    2552 flags.go:64] FLAG: --eviction-soft=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203924    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203927    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203930    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203933    2552 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203935    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203938    2552 flags.go:64] FLAG: --fail-swap-on="true"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203941    2552 flags.go:64] FLAG: --feature-gates=""
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203945    2552 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203948    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203951    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203954    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203957    2552 flags.go:64] FLAG: --healthz-port="10248"
May 26 06:56:58.207498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203960    2552 flags.go:64] FLAG: --help="false"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203962    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203965    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203968    2552 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203971    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203974    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203978    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203981    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203983    2552 flags.go:64] FLAG: --image-service-endpoint=""
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203986    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203990    2552 flags.go:64] FLAG: --kube-api-burst="100"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203993    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.203997    2552 flags.go:64] FLAG: --kube-api-qps="50"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204000    2552 flags.go:64] FLAG: --kube-reserved=""
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204002    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204010    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204013    2552 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204015    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204018    2552 flags.go:64] FLAG: --lock-file=""
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204021    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204024    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204027    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204032    2552 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 06:56:58.208112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204035    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204038    2552 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204040    2552 flags.go:64] FLAG: --logging-format="text"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204043    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204046    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204049    2552 flags.go:64] FLAG: --manifest-url=""
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204052    2552 flags.go:64] FLAG: --manifest-url-header=""
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204056    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204059    2552 flags.go:64] FLAG: --max-open-files="1000000"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204063    2552 flags.go:64] FLAG: --max-pods="110"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204066    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204069    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204072    2552 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204074    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204077    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204080    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204083    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204090    2552 flags.go:64] FLAG: --node-status-max-images="50"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204093    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204096    2552 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204099    2552 flags.go:64] FLAG: --pod-cidr=""
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204103    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204107    2552 flags.go:64] FLAG: --pod-manifest-path=""
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204110    2552 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 06:56:58.208686 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204114    2552 flags.go:64] FLAG: --pods-per-core="0"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204117    2552 flags.go:64] FLAG: --port="10250"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204121    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204124    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-009f23a1aa76a9ee1"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204128    2552 flags.go:64] FLAG: --qos-reserved=""
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204131    2552 flags.go:64] FLAG: --read-only-port="10255"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204134    2552 flags.go:64] FLAG: --register-node="true"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204137    2552 flags.go:64] FLAG: --register-schedulable="true"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204139    2552 flags.go:64] FLAG: --register-with-taints=""
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204143    2552 flags.go:64] FLAG: --registry-burst="10"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204146    2552 flags.go:64] FLAG: --registry-qps="5"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204148    2552 flags.go:64] FLAG: --reserved-cpus=""
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204151    2552 flags.go:64] FLAG: --reserved-memory=""
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204155    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204158    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204161    2552 flags.go:64] FLAG: --rotate-certificates="false"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204164    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204167    2552 flags.go:64] FLAG: --runonce="false"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204170    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204173    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204176    2552 flags.go:64] FLAG: --seccomp-default="false"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204179    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204181    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204184    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204187    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204191    2552 flags.go:64] FLAG: --storage-driver-password="root"
May 26 06:56:58.209287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204194    2552 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204196    2552 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204199    2552 flags.go:64] FLAG: --storage-driver-user="root"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204202    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204205    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204208    2552 flags.go:64] FLAG: --system-cgroups=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204213    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204218    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204221    2552 flags.go:64] FLAG: --tls-cert-file=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204224    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204228    2552 flags.go:64] FLAG: --tls-min-version=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204231    2552 flags.go:64] FLAG: --tls-private-key-file=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204234    2552 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204237    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204240    2552 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204243    2552 flags.go:64] FLAG: --v="2"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204247    2552 flags.go:64] FLAG: --version="false"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204251    2552 flags.go:64] FLAG: --vmodule=""
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204255    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204259    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204348    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204351    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204355    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:58.209947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204359    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204363    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204368    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204371    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204374    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204377    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204380    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204383    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204385    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204388    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204391    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204404    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204407    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204410    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204413    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204417    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204420    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204423    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204426    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204428    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:58.210502 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204431    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204434    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204436    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204439    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204441    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204444    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204446    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204449    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204451    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204454    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204456    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204459    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204462    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204465    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204467    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204470    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204472    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204474    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204477    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204479    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:58.211078 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204482    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204484    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204487    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204489    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204492    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204494    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204497    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204502    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204506    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204508    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204511    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204514    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204517    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204519    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204522    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204524    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204527    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204529    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204531    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204534    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:58.211586 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204536    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204539    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204541    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204544    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204546    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204549    2552 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204551    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204554    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204557    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204560    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204562    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204564    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204567    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204569    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204572    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204574    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204577    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204579    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204582    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204586    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:58.212077 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204590    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204593    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.204595    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.204600    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.211196    2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.211300    2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211350    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211354    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211358    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211361    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211364    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211367    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211370    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211372    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211375    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:58.212572 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211377    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211380    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211383    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211386    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211388    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211391    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211408    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211411    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211413    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211416    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211419    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211421    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211424    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211426    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211429    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211432    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211435    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211438    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211441    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:58.212979 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211443    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211446    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211448    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211456    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211459    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211461    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211464    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211466    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211469    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211472    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211476    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211479    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211482    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211485    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211488    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211490    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211493    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211495    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211498    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211501    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:58.213455 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211503    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211506    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211508    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211511    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211513    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211516    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211518    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211521    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211524    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211526    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211529    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211532    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211534    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211537    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211540    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211542    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211546    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211548    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211551    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211553    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:58.213931 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211556    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211558    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211561    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211563    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211566    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211568    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211571    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211573    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211576    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211580    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211583    2552 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211587    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211590    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211593    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211596    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211599    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211602    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:58.214421 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211605    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.211610    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211718    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211723    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211726    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211729    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211732    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211734    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211737    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211739    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211742    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211744    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211747    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211750    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211753    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211755    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:56:58.214887 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211758    2552 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211760    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211763    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211765    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211768    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211770    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211773    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211775    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211778    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211780    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211783    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211785    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211788    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211791    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211793    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211797    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211799    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211802    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211804    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211807    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:56:58.215288 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211810    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211812    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211814    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211817    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211820    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211822    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211825    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211827    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211830    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211833    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211835    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211837    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211840    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211842    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211845    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211847    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211850    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211852    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211854    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211857    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:56:58.215845 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211860    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211862    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211865    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211867    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211870    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211873    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211877    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211879    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211882    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211885    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211888    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211891    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211893    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211896    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211898    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211901    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211903    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211906    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211908    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:56:58.216447 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211910    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211913    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211916    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211919    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211923    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211926    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211929    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211932    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211935    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211937    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211940    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211942    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:58.211944    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.211951    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.212659    2552 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 06:56:58.216947 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.214589    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 06:56:58.217346 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.215655    2552 server.go:1019] "Starting client certificate rotation"
May 26 06:56:58.217346 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.215768    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:56:58.217346 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.215818    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:56:58.245817 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.245794    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:56:58.253785 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.253726    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:56:58.262287 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.262267    2552 log.go:25] "Validated CRI v1 runtime API"
May 26 06:56:58.268456 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.268440    2552 log.go:25] "Validated CRI v1 image API"
May 26 06:56:58.271578 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.271555    2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 06:56:58.273869 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.273852    2552 fs.go:135] Filesystem UUIDs: map[29e3e28e-91a7-4c9c-badf-a04015df40bb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e672df56-c39f-4f6f-b3af-aec168575193:/dev/nvme0n1p4]
May 26 06:56:58.273949 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.273869    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 06:56:58.275904 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.275886    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:56:58.278038 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.277933    2552 manager.go:217] Machine: {Timestamp:2026-05-26 06:56:58.277457127 +0000 UTC m=+0.498311523 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087169 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25143ca4ba42edc9cbd414790c6f61 SystemUUID:ec25143c-a4ba-42ed-c9cb-d414790c6f61 BootID:8d867255-93ae-4466-a707-15840808521d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:af:86:c9:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:af:86:c9:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:83:9b:df:22:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 06:56:58.278545 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.278535    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 06:56:58.278653 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.278641    2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 06:56:58.280219 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.280193    2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 06:56:58.280405 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.280222    2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 06:56:58.280455 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.280414    2552 topology_manager.go:138] "Creating topology manager with none policy"
May 26 06:56:58.280455 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.280423    2552 container_manager_linux.go:306] "Creating device plugin manager"
May 26 06:56:58.280455 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.280431    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:56:58.281863 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.281852    2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:56:58.283082 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.283072    2552 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:56:58.283183 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.283174    2552 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 06:56:58.285451 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.285442    2552 kubelet.go:491] "Attempting to sync node with API server"
May 26 06:56:58.285492 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.285460    2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 06:56:58.285492 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.285471    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 06:56:58.285492 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.285479    2552 kubelet.go:397] "Adding apiserver pod source"
May 26 06:56:58.285492 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.285487    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 06:56:58.286630 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.286619    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:56:58.286683 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.286636    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:56:58.289899 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.289882    2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 06:56:58.291736 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.291723    2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 06:56:58.292714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292697    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292719    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292729    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292737    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292749    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292758    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292765    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292770    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292777    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292782    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 06:56:58.292798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292791    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 06:56:58.293138 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.292971    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 06:56:58.293919 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.293909    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 06:56:58.293957 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.293920    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 06:56:58.297252 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.297239    2552 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 06:56:58.297315 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.297283    2552 server.go:1295] "Started kubelet"
May 26 06:56:58.297362 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.297329    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 06:56:58.298022 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.297969    2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 06:56:58.298095 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.298043    2552 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 06:56:58.298509 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.298481    2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 06:56:58.298588 ip-10-0-133-78 systemd[1]: Started Kubernetes Kubelet.
May 26 06:56:58.298787 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.298756    2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 06:56:58.298927 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.298907    2552 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 06:56:58.299616 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.299411    2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 06:56:58.300935 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.300921    2552 server.go:317] "Adding debug handlers to kubelet server"
May 26 06:56:58.305849 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.305819    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbb6h"
May 26 06:56:58.309700 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.309683    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 06:56:58.309700 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.309694    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 06:56:58.309882 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.309859    2552 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 06:56:58.309882 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.309880    2552 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 06:56:58.310029 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.309949    2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 06:56:58.310029 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310025    2552 reconstruct.go:97] "Volume reconstruction finished"
May 26 06:56:58.310123 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310033    2552 reconciler.go:26] "Reconciler: start to sync state"
May 26 06:56:58.310334 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310318    2552 factory.go:55] Registering systemd factory
May 26 06:56:58.310427 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310365    2552 factory.go:223] Registration of the systemd container factory successfully
May 26 06:56:58.310682 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.310660    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.310776 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310765    2552 factory.go:153] Registering CRI-O factory
May 26 06:56:58.310837 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310780    2552 factory.go:223] Registration of the crio container factory successfully
May 26 06:56:58.310887 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310866    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 06:56:58.310887 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310886    2552 factory.go:103] Registering Raw factory
May 26 06:56:58.310986 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.310906    2552 manager.go:1196] Started watching for new ooms in manager
May 26 06:56:58.310986 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.310915    2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 06:56:58.311341 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.311327    2552 manager.go:319] Starting recovery of all containers
May 26 06:56:58.311530 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.310560    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-78.ec2.internal.18b30b39427170b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-78.ec2.internal,UID:ip-10-0-133-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-78.ec2.internal,},FirstTimestamp:2026-05-26 06:56:58.297249974 +0000 UTC m=+0.518104371,LastTimestamp:2026-05-26 06:56:58.297249974 +0000 UTC m=+0.518104371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-78.ec2.internal,}"
May 26 06:56:58.312737 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.312720    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbb6h"
May 26 06:56:58.321444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.321389    2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:58.322141 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.322126    2552 manager.go:324] Recovery completed
May 26 06:56:58.323541 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.323449    2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-78.ec2.internal\" not found" node="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.326482 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.326470    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.329380 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329365    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.329380 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329388    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.329512 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329414    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.329902 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329888    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 06:56:58.329902 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329901    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 06:56:58.329977 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.329916    2552 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:56:58.332084 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.332074    2552 policy_none.go:49] "None policy: Start"
May 26 06:56:58.332130 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.332089    2552 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 06:56:58.332130 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.332103    2552 state_mem.go:35] "Initializing new in-memory state store"
May 26 06:56:58.367934 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.367915    2552 manager.go:341] "Starting Device Plugin manager"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.367960    2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.367970    2552 server.go:85] "Starting device plugin registration server"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.368175    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.368186    2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.368287    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.368419    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.368432    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.369203    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 06:56:58.381425 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.369241    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.443674 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.443651    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 06:56:58.444820 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.444773    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 06:56:58.444820 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.444800    2552 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 06:56:58.444820 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.444815    2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 06:56:58.444820 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.444822    2552 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 06:56:58.445032 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.444889    2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 06:56:58.449478 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.449462    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:58.468777 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.468739    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.469489 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.469474    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.469556 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.469502    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.469556 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.469512    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.469556 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.469533    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.478300 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.478286    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.478342 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.478303    2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-78.ec2.internal\": node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.491012 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.490988    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.545317 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.545299    2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"]
May 26 06:56:58.545372 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.545367    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.546102 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.546088    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.546151 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.546115    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.546151 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.546129    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.547244 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547232    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.547379 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547365    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.547440 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547410    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.547858 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547845    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.547917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547865    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.547917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547868    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.547917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547874    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.547917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547884    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.547917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.547895    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.548930 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.548912    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.549006 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.548942    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:56:58.549590 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.549576    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:56:58.549647 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.549600    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:56:58.549647 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.549609    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeHasSufficientPID"
May 26 06:56:58.575988 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.575970    2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-78.ec2.internal\" not found" node="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.579391 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.579377    2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-78.ec2.internal\" not found" node="ip-10-0-133-78.ec2.internal"
May 26 06:56:58.591406 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.591382    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.611381 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.611360    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.611452 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.611389    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.611452 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.611424    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87f4493db5ec011f6b8f45135568252e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-78.ec2.internal\" (UID: \"87f4493db5ec011f6b8f45135568252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.691684 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.691663    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.711996 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.711943    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.711996 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.711971    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.711996 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.711989    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87f4493db5ec011f6b8f45135568252e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-78.ec2.internal\" (UID: \"87f4493db5ec011f6b8f45135568252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.712176 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.712038    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.712176 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.712043    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b78e871d535466906932bd5dfa94e652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal\" (UID: \"b78e871d535466906932bd5dfa94e652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.712176 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.712108    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87f4493db5ec011f6b8f45135568252e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-78.ec2.internal\" (UID: \"87f4493db5ec011f6b8f45135568252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.792342 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.792320    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.878818 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.878776    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.882605 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:58.882587    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:58.893264 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.893213    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:58.993861 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:58.993792    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.094263 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.094239    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.194827 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.194804    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.215183 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.215168    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 06:56:59.215307 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.215291    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 06:56:59.215362 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.215300    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 06:56:59.295809 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.295754    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.310417 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.310382    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 06:56:59.314801 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.314770    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 06:51:58 +0000 UTC" deadline="2028-01-08 20:13:50.431884113 +0000 UTC"
May 26 06:56:59.314879 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.314801    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14221h16m51.117086494s"
May 26 06:56:59.320329 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.320312    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:56:59.339057 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.339029    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7txj"
May 26 06:56:59.347455 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.347440    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7txj"
May 26 06:56:59.396684 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.396662    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.402285 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:59.402254    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78e871d535466906932bd5dfa94e652.slice/crio-a50945234f7f13e42019afce94a26c58a106e70618c5bdf96e639796421f7005 WatchSource:0}: Error finding container a50945234f7f13e42019afce94a26c58a106e70618c5bdf96e639796421f7005: Status 404 returned error can't find the container with id a50945234f7f13e42019afce94a26c58a106e70618c5bdf96e639796421f7005
May 26 06:56:59.402470 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:56:59.402449    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f4493db5ec011f6b8f45135568252e.slice/crio-92b3323ca12bccb3edcc179bea1004ca25936d753771be11e36b6ad18e75cee7 WatchSource:0}: Error finding container 92b3323ca12bccb3edcc179bea1004ca25936d753771be11e36b6ad18e75cee7: Status 404 returned error can't find the container with id 92b3323ca12bccb3edcc179bea1004ca25936d753771be11e36b6ad18e75cee7
May 26 06:56:59.405610 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.405597    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:56:59.444951 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.444768    2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:59.448016 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.447978    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal" event={"ID":"b78e871d535466906932bd5dfa94e652","Type":"ContainerStarted","Data":"a50945234f7f13e42019afce94a26c58a106e70618c5bdf96e639796421f7005"}
May 26 06:56:59.448816 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.448798    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal" event={"ID":"87f4493db5ec011f6b8f45135568252e","Type":"ContainerStarted","Data":"92b3323ca12bccb3edcc179bea1004ca25936d753771be11e36b6ad18e75cee7"}
May 26 06:56:59.496956 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.496935    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.597459 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.597385    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.697851 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.697824    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.798673 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:56:59.798641    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-78.ec2.internal\" not found"
May 26 06:56:59.862803 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.862776    2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:56:59.909952 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.909916    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal"
May 26 06:56:59.922661 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.922518    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:56:59.923912 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.923679    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal"
May 26 06:56:59.933148 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:56:59.933120    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:57:00.287454 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.287372    2552 apiserver.go:52] "Watching apiserver"
May 26 06:57:00.294161 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.294135    2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 06:57:00.294543 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.294519    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-9t8jb","openshift-cluster-node-tuning-operator/tuned-bqr8g","openshift-multus/multus-additional-cni-plugins-fzxs6","openshift-network-diagnostics/network-check-target-zgmwn","openshift-network-operator/iptables-alerter-tq2pr","kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m","openshift-dns/node-resolver-295qq","openshift-image-registry/node-ca-wlbl6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal","openshift-multus/multus-qj4kf","openshift-multus/network-metrics-daemon-wthnw","openshift-ovn-kubernetes/ovnkube-node-6d6fn"]
May 26 06:57:00.295909 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.295892    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.296954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.296935    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.298034 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.298014    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.298421 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.298386    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 06:57:00.298578 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.298558    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 06:57:00.298644 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.298603    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 06:57:00.298690 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.298648    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sxrr6\""
May 26 06:57:00.299293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.299133    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:00.299293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.299145    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 06:57:00.299293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.299175    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 06:57:00.299293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.299151    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqs6h\""
May 26 06:57:00.299293 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.299224    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:00.300419 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300218    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 06:57:00.300419 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300233    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 06:57:00.300419 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300219    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 06:57:00.300619 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300425    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phqdf\""
May 26 06:57:00.300619 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300453    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 06:57:00.300619 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.300479    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 06:57:00.301738 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.301717    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.302975 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.302945    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.303079 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.303018    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.303610 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.303592    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 06:57:00.303800 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.303779    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 06:57:00.303958 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.303942    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 06:57:00.304049 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.303971    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xgv2c\""
May 26 06:57:00.304203 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.304186    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.305064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305048    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 06:57:00.305164 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305113    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 06:57:00.305254 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305237    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlts9\""
May 26 06:57:00.305468 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305439    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gfjm8\""
May 26 06:57:00.305849 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305651    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 06:57:00.305849 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305655    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.305849 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.305717    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 06:57:00.307924 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.307189    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 06:57:00.307924 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.307259    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hngph\""
May 26 06:57:00.307924 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.307353    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 06:57:00.307924 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.307921    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 06:57:00.308465 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.308119    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 06:57:00.308465 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.308348    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rpcdr\""
May 26 06:57:00.310233 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.310214    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.310436 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.310361    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:00.312643 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.312626    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.315036 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.314878    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 06:57:00.315036 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.314914    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 06:57:00.315036 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.314951    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 06:57:00.315202 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.315193    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 06:57:00.315668 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.315649    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ln2d6\""
May 26 06:57:00.315765 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.315652    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 06:57:00.316254 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.316235    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 06:57:00.319859 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319840    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-lib-modules\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.319954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319866    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-var-lib-kubelet\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.319954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j4qp\" (UniqueName: \"kubernetes.io/projected/c4293f84-219f-4096-9112-86b361db2d37-kube-api-access-8j4qp\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.319954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319909    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-multus-certs\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.319954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319934    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfp9v\" (UniqueName: \"kubernetes.io/projected/e5a01383-3062-4834-a2a7-f44acf0dc101-kube-api-access-qfp9v\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319957    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-netd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.319981    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320023    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4rn\" (UniqueName: \"kubernetes.io/projected/9d8174f3-bc7a-4b5d-9e92-88014c915161-kube-api-access-kp4rn\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320049    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4293f84-219f-4096-9112-86b361db2d37-host\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-socket-dir-parent\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320092    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-hostroot\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.320131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320120    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65da128f-a9a9-4330-ae51-b544ae698a52-agent-certs\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320143    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-k8s-cni-cncf-io\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b1ff199-6dc2-4b3a-bb13-bd873600f564-hosts-file\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320213    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysconfig\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320239    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320261    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-host\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320288    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjzp\" (UniqueName: \"kubernetes.io/projected/9f40c1a0-07af-4b20-80f1-05fd197eaa64-kube-api-access-5sjzp\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320314    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-systemd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320337    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-var-lib-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320375    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320418    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-bin\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320444 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320443    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-env-overrides\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320462    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-modprobe-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320480    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-run\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320506    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f40c1a0-07af-4b20-80f1-05fd197eaa64-iptables-alerter-script\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65da128f-a9a9-4330-ae51-b544ae698a52-konnectivity-ca\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320659    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320694    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b1ff199-6dc2-4b3a-bb13-bd873600f564-tmp-dir\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320748    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovn-node-metrics-cert\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320785    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7c8\" (UniqueName: \"kubernetes.io/projected/9e808798-a262-4a85-bcf5-98ba8f0abdad-kube-api-access-lc7c8\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.320862 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320837    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-etc-tuned\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320876    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-cnibin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.320996    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-os-release\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321023    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-multus\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321048    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-conf-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-socket-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-etc-selinux\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-sys-fs\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-systemd-units\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321175    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-netns\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321199    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-ovn\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321223    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-script-lib\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321244    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-conf\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.321313 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321282    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-tmp\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-cnibin\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321352    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321368    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wwf\" (UniqueName: \"kubernetes.io/projected/3416211a-32ce-4924-a1c4-f7a52c7e6494-kube-api-access-h4wwf\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321413    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-etc-kubernetes\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwwk\" (UniqueName: \"kubernetes.io/projected/6b1ff199-6dc2-4b3a-bb13-bd873600f564-kube-api-access-dkwwk\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-system-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321538    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-kubelet\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321566    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-config\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321587    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-system-cni-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321624    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-device-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321656    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2rkm\" (UniqueName: \"kubernetes.io/projected/2c3534cd-da84-4818-ab24-378f8ebef1fe-kube-api-access-d2rkm\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321719    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-log-socket\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321751    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321780    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-sys\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.321871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321801    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-os-release\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321816    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-netns\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321839    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321860    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-cni-binary-copy\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321878    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-bin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321901    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-kubelet\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321934    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321964    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbjg\" (UniqueName: \"kubernetes.io/projected/021f0595-5f2e-41c3-9153-b90de710024d-kube-api-access-9wbjg\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.321989    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-daemon-config\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322014    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-kubernetes\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-systemd\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322096    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f40c1a0-07af-4b20-80f1-05fd197eaa64-host-slash\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322124    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4293f84-219f-4096-9112-86b361db2d37-serviceca\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322146    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322168    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-slash\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322190    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-registration-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322216    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-etc-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.322557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.322243    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-node-log\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.342186 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.342167    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:57:00.348210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.348185    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:51:59 +0000 UTC" deadline="2028-01-25 12:05:31.236056803 +0000 UTC"
May 26 06:57:00.348210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.348210    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h8m30.887850446s"
May 26 06:57:00.383590 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.383571    2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:57:00.411246 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.411223    2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 06:57:00.422421 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422387    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-registration-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.422520 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422429    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-etc-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.422520 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422452    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-node-log\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.422520 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422476    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-lib-modules\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422511    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-etc-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422515    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-registration-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422535    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-node-log\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422561    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-var-lib-kubelet\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422593    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-lib-modules\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422598    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8j4qp\" (UniqueName: \"kubernetes.io/projected/c4293f84-219f-4096-9112-86b361db2d37-kube-api-access-8j4qp\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422625    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-multus-certs\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422630    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-var-lib-kubelet\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.422662 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422650    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfp9v\" (UniqueName: \"kubernetes.io/projected/e5a01383-3062-4834-a2a7-f44acf0dc101-kube-api-access-qfp9v\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422668    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-netd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422670    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-multus-certs\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422683    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422700    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4rn\" (UniqueName: \"kubernetes.io/projected/9d8174f3-bc7a-4b5d-9e92-88014c915161-kube-api-access-kp4rn\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422722    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4293f84-219f-4096-9112-86b361db2d37-host\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422727    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-netd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422747    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-socket-dir-parent\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422789    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4293f84-219f-4096-9112-86b361db2d37-host\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422792    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-hostroot\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422818    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65da128f-a9a9-4330-ae51-b544ae698a52-agent-certs\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422843    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-socket-dir-parent\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422851    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422862    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-hostroot\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422854    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-k8s-cni-cncf-io\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422891    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-k8s-cni-cncf-io\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422915    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b1ff199-6dc2-4b3a-bb13-bd873600f564-hosts-file\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422951    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysconfig\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422975    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422986    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b1ff199-6dc2-4b3a-bb13-bd873600f564-hosts-file\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.422996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-host\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423021    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sjzp\" (UniqueName: \"kubernetes.io/projected/9f40c1a0-07af-4b20-80f1-05fd197eaa64-kube-api-access-5sjzp\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423030    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysconfig\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423069    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-systemd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423074    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-host\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423089    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-var-lib-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423111    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423126    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-systemd\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423132    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-bin\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423146    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-var-lib-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423151    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-env-overrides\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423191    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-modprobe-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423179    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-cni-bin\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423159    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423232    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-run\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.423907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423267    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f40c1a0-07af-4b20-80f1-05fd197eaa64-iptables-alerter-script\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423274    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-modprobe-d\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423304    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65da128f-a9a9-4330-ae51-b544ae698a52-konnectivity-ca\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423329    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-run\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423434    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423444    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423464    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b1ff199-6dc2-4b3a-bb13-bd873600f564-tmp-dir\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423489    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovn-node-metrics-cert\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423514    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7c8\" (UniqueName: \"kubernetes.io/projected/9e808798-a262-4a85-bcf5-98ba8f0abdad-kube-api-access-lc7c8\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423539    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-etc-tuned\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423562    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423595    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-env-overrides\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423605    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423635    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-cnibin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423661    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-os-release\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423686    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-multus\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423731    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-conf-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423758    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-socket-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.424733 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423782    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-etc-selinux\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423808    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-sys-fs\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423831    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f40c1a0-07af-4b20-80f1-05fd197eaa64-iptables-alerter-script\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423843    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-systemd-units\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423847    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65da128f-a9a9-4330-ae51-b544ae698a52-konnectivity-ca\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423905    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-systemd-units\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423913    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-netns\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423949    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-multus\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423957    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-ovn\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423971    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-os-release\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423985    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-script-lib\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423992    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-conf-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.423999    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b1ff199-6dc2-4b3a-bb13-bd873600f564-tmp-dir\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424027    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-conf\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424054    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-tmp\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424086    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-ovn\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424080    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-cnibin\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424119    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-etc-selinux\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.425582 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424149    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-cnibin\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424219    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-sys-fs\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424237    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-socket-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424318    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-sysctl-conf\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424056    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-run-netns\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424518    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-script-lib\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424590    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-cnibin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424599    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424638    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424665    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wwf\" (UniqueName: \"kubernetes.io/projected/3416211a-32ce-4924-a1c4-f7a52c7e6494-kube-api-access-h4wwf\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424689    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-etc-kubernetes\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424714    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwwk\" (UniqueName: \"kubernetes.io/projected/6b1ff199-6dc2-4b3a-bb13-bd873600f564-kube-api-access-dkwwk\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424722    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424740    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-system-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424761    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-etc-kubernetes\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424766    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-kubelet\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424793    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-config\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.426376 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424811    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424865    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-system-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424873    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-system-cni-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424909    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-kubelet\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424817    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-system-cni-dir\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424965    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-device-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.424991    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2rkm\" (UniqueName: \"kubernetes.io/projected/2c3534cd-da84-4818-ab24-378f8ebef1fe-kube-api-access-d2rkm\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425016    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425058    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-log-socket\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425086    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425140    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425181    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-run-openvswitch\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425218    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-log-socket\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425264    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5a01383-3062-4834-a2a7-f44acf0dc101-device-dir\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425271    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-sys\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-sys\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425311    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-os-release\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425336    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovnkube-config\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425347    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-netns\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425365    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3416211a-32ce-4924-a1c4-f7a52c7e6494-os-release\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425374    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425420    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-cni-binary-copy\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425443    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-bin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425430    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-run-netns\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425484    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-kubelet\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425513    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425538    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbjg\" (UniqueName: \"kubernetes.io/projected/021f0595-5f2e-41c3-9153-b90de710024d-kube-api-access-9wbjg\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425564    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-daemon-config\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425587    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-kubernetes\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425608    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-systemd\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425634    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f40c1a0-07af-4b20-80f1-05fd197eaa64-host-slash\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425659    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4293f84-219f-4096-9112-86b361db2d37-serviceca\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425684    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425708    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-slash\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425777    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e808798-a262-4a85-bcf5-98ba8f0abdad-host-slash\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.427815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425816    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-kubelet\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425819    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3416211a-32ce-4924-a1c4-f7a52c7e6494-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425485    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-host-var-lib-cni-bin\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.425902    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425923    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-cni-binary-copy\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.425984    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:00.925950485 +0000 UTC m=+3.146804892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.425987    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-systemd\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.426056    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f40c1a0-07af-4b20-80f1-05fd197eaa64-host-slash\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.426199    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-cni-dir\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.426261    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021f0595-5f2e-41c3-9153-b90de710024d-etc-kubernetes\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.426435    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d8174f3-bc7a-4b5d-9e92-88014c915161-multus-daemon-config\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.426483    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4293f84-219f-4096-9112-86b361db2d37-serviceca\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.427000    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-tmp\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.427245    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e808798-a262-4a85-bcf5-98ba8f0abdad-ovn-node-metrics-cert\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.427280    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021f0595-5f2e-41c3-9153-b90de710024d-etc-tuned\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.428503 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.427286    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65da128f-a9a9-4330-ae51-b544ae698a52-agent-certs\") pod \"konnectivity-agent-9t8jb\" (UID: \"65da128f-a9a9-4330-ae51-b544ae698a52\") " pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.432875 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.432521    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:00.432875 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.432541    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:00.432875 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.432553    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:00.432875 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.432779    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:00.932760193 +0000 UTC m=+3.153614596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:00.433617 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.433522    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfp9v\" (UniqueName: \"kubernetes.io/projected/e5a01383-3062-4834-a2a7-f44acf0dc101-kube-api-access-qfp9v\") pod \"aws-ebs-csi-driver-node-56z4m\" (UID: \"e5a01383-3062-4834-a2a7-f44acf0dc101\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.435867 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.435844    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4rn\" (UniqueName: \"kubernetes.io/projected/9d8174f3-bc7a-4b5d-9e92-88014c915161-kube-api-access-kp4rn\") pod \"multus-qj4kf\" (UID: \"9d8174f3-bc7a-4b5d-9e92-88014c915161\") " pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.435959 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.435945    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbjg\" (UniqueName: \"kubernetes.io/projected/021f0595-5f2e-41c3-9153-b90de710024d-kube-api-access-9wbjg\") pod \"tuned-bqr8g\" (UID: \"021f0595-5f2e-41c3-9153-b90de710024d\") " pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.436507 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.436357    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7c8\" (UniqueName: \"kubernetes.io/projected/9e808798-a262-4a85-bcf5-98ba8f0abdad-kube-api-access-lc7c8\") pod \"ovnkube-node-6d6fn\" (UID: \"9e808798-a262-4a85-bcf5-98ba8f0abdad\") " pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.436774 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.436744    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wwf\" (UniqueName: \"kubernetes.io/projected/3416211a-32ce-4924-a1c4-f7a52c7e6494-kube-api-access-h4wwf\") pod \"multus-additional-cni-plugins-fzxs6\" (UID: \"3416211a-32ce-4924-a1c4-f7a52c7e6494\") " pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.437518 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.437497    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sjzp\" (UniqueName: \"kubernetes.io/projected/9f40c1a0-07af-4b20-80f1-05fd197eaa64-kube-api-access-5sjzp\") pod \"iptables-alerter-tq2pr\" (UID: \"9f40c1a0-07af-4b20-80f1-05fd197eaa64\") " pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.437914 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.437890    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2rkm\" (UniqueName: \"kubernetes.io/projected/2c3534cd-da84-4818-ab24-378f8ebef1fe-kube-api-access-d2rkm\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.438002 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.437978    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwwk\" (UniqueName: \"kubernetes.io/projected/6b1ff199-6dc2-4b3a-bb13-bd873600f564-kube-api-access-dkwwk\") pod \"node-resolver-295qq\" (UID: \"6b1ff199-6dc2-4b3a-bb13-bd873600f564\") " pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.438658 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.438638    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j4qp\" (UniqueName: \"kubernetes.io/projected/c4293f84-219f-4096-9112-86b361db2d37-kube-api-access-8j4qp\") pod \"node-ca-wlbl6\" (UID: \"c4293f84-219f-4096-9112-86b361db2d37\") " pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.612532 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.612494    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m"
May 26 06:57:00.619172 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.619149    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqr8g"
May 26 06:57:00.625730 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.625711    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzxs6"
May 26 06:57:00.631306 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.631287    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tq2pr"
May 26 06:57:00.637801 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.637782    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:00.644260 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.644240    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-295qq"
May 26 06:57:00.649681 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.649664    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlbl6"
May 26 06:57:00.656252 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.656235    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj4kf"
May 26 06:57:00.661843 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.661823    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:00.929594 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:00.929516    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:00.929718 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.929660    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:00.929767 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:00.929726    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:01.929707939 +0000 UTC m=+4.150562323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:01.028675 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.028643    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3416211a_32ce_4924_a1c4_f7a52c7e6494.slice/crio-2693966e6a5e8277aa5f27e5b2407691411c9cce8917aab747ada6e0b13a09e6 WatchSource:0}: Error finding container 2693966e6a5e8277aa5f27e5b2407691411c9cce8917aab747ada6e0b13a09e6: Status 404 returned error can't find the container with id 2693966e6a5e8277aa5f27e5b2407691411c9cce8917aab747ada6e0b13a09e6
May 26 06:57:01.029910 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.029821    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:01.029985 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.029972    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:01.030045 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.029989    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:01.030045 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.030001    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:01.030149 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.030063    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:02.030040746 +0000 UTC m=+4.250895134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:01.031589 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.031556    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1ff199_6dc2_4b3a_bb13_bd873600f564.slice/crio-eb6407afb5e96707fa4128416228681354b24f29f2ea8a4139414aad877ca5b9 WatchSource:0}: Error finding container eb6407afb5e96707fa4128416228681354b24f29f2ea8a4139414aad877ca5b9: Status 404 returned error can't find the container with id eb6407afb5e96707fa4128416228681354b24f29f2ea8a4139414aad877ca5b9
May 26 06:57:01.033369 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.033344    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e808798_a262_4a85_bcf5_98ba8f0abdad.slice/crio-d177683c732ff08949df83aa688a2fee3af7b7f44cd3ede99b7b2a6c350c6f60 WatchSource:0}: Error finding container d177683c732ff08949df83aa688a2fee3af7b7f44cd3ede99b7b2a6c350c6f60: Status 404 returned error can't find the container with id d177683c732ff08949df83aa688a2fee3af7b7f44cd3ede99b7b2a6c350c6f60
May 26 06:57:01.034179 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.034153    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a01383_3062_4834_a2a7_f44acf0dc101.slice/crio-6b75f78f27b209ae7705db0135245291754c21e0f67276790a9b68991145d33a WatchSource:0}: Error finding container 6b75f78f27b209ae7705db0135245291754c21e0f67276790a9b68991145d33a: Status 404 returned error can't find the container with id 6b75f78f27b209ae7705db0135245291754c21e0f67276790a9b68991145d33a
May 26 06:57:01.034761 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.034687    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021f0595_5f2e_41c3_9153_b90de710024d.slice/crio-c97eea674c7c3c15e650018f177a90d085e5164941952c05ce89fe79cc8fb3d9 WatchSource:0}: Error finding container c97eea674c7c3c15e650018f177a90d085e5164941952c05ce89fe79cc8fb3d9: Status 404 returned error can't find the container with id c97eea674c7c3c15e650018f177a90d085e5164941952c05ce89fe79cc8fb3d9
May 26 06:57:01.035809 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.035727    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65da128f_a9a9_4330_ae51_b544ae698a52.slice/crio-ecd3c39c4814c1d25143417c813016de0ca14a5786b3a7be59f94008080199ca WatchSource:0}: Error finding container ecd3c39c4814c1d25143417c813016de0ca14a5786b3a7be59f94008080199ca: Status 404 returned error can't find the container with id ecd3c39c4814c1d25143417c813016de0ca14a5786b3a7be59f94008080199ca
May 26 06:57:01.036957 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.036923    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8174f3_bc7a_4b5d_9e92_88014c915161.slice/crio-a1a9c4620fda6b29934ea705c7776e6e6bc0df9343e779ac3d29fd8715e55ac8 WatchSource:0}: Error finding container a1a9c4620fda6b29934ea705c7776e6e6bc0df9343e779ac3d29fd8715e55ac8: Status 404 returned error can't find the container with id a1a9c4620fda6b29934ea705c7776e6e6bc0df9343e779ac3d29fd8715e55ac8
May 26 06:57:01.037924 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.037899    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4293f84_219f_4096_9112_86b361db2d37.slice/crio-57a83187a7a1d42db96b3e20bc0e8b92e6f8a5704ce62b05dbf52fd01f05491b WatchSource:0}: Error finding container 57a83187a7a1d42db96b3e20bc0e8b92e6f8a5704ce62b05dbf52fd01f05491b: Status 404 returned error can't find the container with id 57a83187a7a1d42db96b3e20bc0e8b92e6f8a5704ce62b05dbf52fd01f05491b
May 26 06:57:01.040567 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:01.039010    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f40c1a0_07af_4b20_80f1_05fd197eaa64.slice/crio-bfd26842345af748a3bba1107f0947611460465e352e263812ac6e917aacb71a WatchSource:0}: Error finding container bfd26842345af748a3bba1107f0947611460465e352e263812ac6e917aacb71a: Status 404 returned error can't find the container with id bfd26842345af748a3bba1107f0947611460465e352e263812ac6e917aacb71a
May 26 06:57:01.348553 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.348528    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:51:59 +0000 UTC" deadline="2028-03-05 22:23:52.894373512 +0000 UTC"
May 26 06:57:01.348553 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.348552    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15591h26m51.54582304s"
May 26 06:57:01.455025 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.454825    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal" event={"ID":"87f4493db5ec011f6b8f45135568252e","Type":"ContainerStarted","Data":"de9874b5b8bf2c31f6fc1f0460090b140dbcc54e199a86fe95012d5005199a5d"}
May 26 06:57:01.459217 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.459190    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m" event={"ID":"e5a01383-3062-4834-a2a7-f44acf0dc101","Type":"ContainerStarted","Data":"6b75f78f27b209ae7705db0135245291754c21e0f67276790a9b68991145d33a"}
May 26 06:57:01.461845 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.461819    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlbl6" event={"ID":"c4293f84-219f-4096-9112-86b361db2d37","Type":"ContainerStarted","Data":"57a83187a7a1d42db96b3e20bc0e8b92e6f8a5704ce62b05dbf52fd01f05491b"}
May 26 06:57:01.464802 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.464776    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj4kf" event={"ID":"9d8174f3-bc7a-4b5d-9e92-88014c915161","Type":"ContainerStarted","Data":"a1a9c4620fda6b29934ea705c7776e6e6bc0df9343e779ac3d29fd8715e55ac8"}
May 26 06:57:01.473691 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.473667    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t8jb" event={"ID":"65da128f-a9a9-4330-ae51-b544ae698a52","Type":"ContainerStarted","Data":"ecd3c39c4814c1d25143417c813016de0ca14a5786b3a7be59f94008080199ca"}
May 26 06:57:01.481723 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.481698    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"d177683c732ff08949df83aa688a2fee3af7b7f44cd3ede99b7b2a6c350c6f60"}
May 26 06:57:01.491178 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.491153    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerStarted","Data":"2693966e6a5e8277aa5f27e5b2407691411c9cce8917aab747ada6e0b13a09e6"}
May 26 06:57:01.493732 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.493703    2552 generic.go:358] "Generic (PLEG): container finished" podID="b78e871d535466906932bd5dfa94e652" containerID="50726876cbcee0d6c85c3476dd5314bef418231b5f935e3321bbe26622d93b5d" exitCode=0
May 26 06:57:01.493825 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.493768    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal" event={"ID":"b78e871d535466906932bd5dfa94e652","Type":"ContainerDied","Data":"50726876cbcee0d6c85c3476dd5314bef418231b5f935e3321bbe26622d93b5d"}
May 26 06:57:01.503062 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.503029    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tq2pr" event={"ID":"9f40c1a0-07af-4b20-80f1-05fd197eaa64","Type":"ContainerStarted","Data":"bfd26842345af748a3bba1107f0947611460465e352e263812ac6e917aacb71a"}
May 26 06:57:01.508142 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.508099    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-78.ec2.internal" podStartSLOduration=2.508083822 podStartE2EDuration="2.508083822s" podCreationTimestamp="2026-05-26 06:56:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:57:01.468602746 +0000 UTC m=+3.689457180" watchObservedRunningTime="2026-05-26 06:57:01.508083822 +0000 UTC m=+3.728938228"
May 26 06:57:01.520143 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.518533    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqr8g" event={"ID":"021f0595-5f2e-41c3-9153-b90de710024d","Type":"ContainerStarted","Data":"c97eea674c7c3c15e650018f177a90d085e5164941952c05ce89fe79cc8fb3d9"}
May 26 06:57:01.524281 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.524257    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-295qq" event={"ID":"6b1ff199-6dc2-4b3a-bb13-bd873600f564","Type":"ContainerStarted","Data":"eb6407afb5e96707fa4128416228681354b24f29f2ea8a4139414aad877ca5b9"}
May 26 06:57:01.937678 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:01.937596    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:01.937842 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.937749    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:01.937842 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:01.937815    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:03.937797091 +0000 UTC m=+6.158651480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:02.039009 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:02.038970    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:02.039267 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.039248    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:02.039324 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.039275    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:02.039324 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.039288    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:02.039450 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.039346    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:04.039327523 +0000 UTC m=+6.260181910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:02.446257 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:02.445748    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:02.446257 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.445868    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:02.447173 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:02.446925    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:02.447173 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:02.447044    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:02.539644 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:02.539582    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal" event={"ID":"b78e871d535466906932bd5dfa94e652","Type":"ContainerStarted","Data":"d9c00d246a360d94cde49d6e4d8d609983f02be67b4df33b0437870e8108498e"}
May 26 06:57:03.955740 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:03.955708    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:03.956171 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:03.955844    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:03.956171 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:03.955902    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:07.955882613 +0000 UTC m=+10.176737000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:04.056649 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:04.056576    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:04.056807 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.056702    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:04.056807 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.056728    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:04.056807 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.056740    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:04.056807 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.056799    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:08.05678089 +0000 UTC m=+10.277635290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:04.445643 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:04.445605    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:04.445809 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.445739    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:04.445809 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:04.445791    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:04.445937 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:04.445918    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:06.445779 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.445747    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:06.446208 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:06.445889    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:06.446355 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.446338    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:06.446511 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:06.446486    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:06.799487 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.798583    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-78.ec2.internal" podStartSLOduration=7.798564514 podStartE2EDuration="7.798564514s" podCreationTimestamp="2026-05-26 06:56:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:57:02.558297205 +0000 UTC m=+4.779151610" watchObservedRunningTime="2026-05-26 06:57:06.798564514 +0000 UTC m=+9.019418921"
May 26 06:57:06.799487 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.799289    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w9jkq"]
May 26 06:57:06.802974 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.802656    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.802974 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:06.802732    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:06.879031 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.878880    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-kubelet-config\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.879031 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.878950    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.879031 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.879002    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-dbus\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.980618 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.980380    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-kubelet-config\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.980618 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.980464    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.980618 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.980535    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-dbus\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.980618 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.980534    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-kubelet-config\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:06.980996 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:06.980707    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:06.980996 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:06.980775    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:07.480753759 +0000 UTC m=+9.701608145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:06.981198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:06.981161    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-dbus\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:07.485493 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:07.485347    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:07.485952 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:07.485525    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:07.485952 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:07.485602    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:08.485581917 +0000 UTC m=+10.706436305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:07.989241 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:07.989206    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:07.989415 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:07.989379    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:07.989495 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:07.989473    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:15.989450466 +0000 UTC m=+18.210304868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:08.090371 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:08.090334    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:08.090562 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.090541    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:08.090620 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.090568    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:08.090620 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.090583    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:08.090718 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.090645    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:16.09062564 +0000 UTC m=+18.311480036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:08.446934    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.447043    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:08.447385    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.447491    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:08.447544    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:08.447698 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.447610    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:08.495129 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:08.494649    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:08.495129 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.494786    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:08.495129 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:08.494839    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:10.494821888 +0000 UTC m=+12.715676276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:10.445510 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:10.445392    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:10.445968 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:10.445423    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:10.445968 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:10.445562    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:10.445968 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:10.445618    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:10.445968 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:10.445722    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:10.445968 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:10.445819    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:10.511874 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:10.511815    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:10.512018 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:10.511966    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:10.512085 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:10.512021    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:14.512003416 +0000 UTC m=+16.732857809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:12.445798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:12.445764    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:12.445798 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:12.445790    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:12.446291 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:12.445764    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:12.446291 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:12.445894    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:12.446291 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:12.445979    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:12.446291 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:12.446062    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:14.446064 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:14.445881    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:14.446515 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:14.445898    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:14.446515 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:14.446138    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:14.446515 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:14.445971    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:14.446515 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:14.446234    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:14.446515 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:14.446310    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:14.541262 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:14.541238    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:14.541372 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:14.541340    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:14.541430 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:14.541381    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:22.541369206 +0000 UTC m=+24.762223589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:16.052020 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:16.051992    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:16.052523 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.052162    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:16.052523 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.052235    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:57:32.052218482 +0000 UTC m=+34.273072866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:16.152874 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:16.152840    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:16.153048 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.152999    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:16.153048 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.153018    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:16.153048 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.153031    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:16.153170 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.153080    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:32.153066276 +0000 UTC m=+34.373920665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:16.445955 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:16.445821    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:16.445955 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:16.445855    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:16.445955 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:16.445827    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:16.445955 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.445954    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:16.446255 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.446022    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:16.446255 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:16.446114    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:18.446729 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:18.446696    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:18.447181 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:18.446805    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:18.447181 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:18.446900    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:18.447181 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:18.447029    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:18.447181 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:18.447073    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:18.447181 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:18.447165    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:19.569557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.569486    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlbl6" event={"ID":"c4293f84-219f-4096-9112-86b361db2d37","Type":"ContainerStarted","Data":"bb68ab50a35bba3472acce5543c2e63a5b96f358f2fd23d9b0af03b9f15c904c"}
May 26 06:57:19.570917 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.570767    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj4kf" event={"ID":"9d8174f3-bc7a-4b5d-9e92-88014c915161","Type":"ContainerStarted","Data":"ced145a9d59d24d0be2d31b4c5439c09a5447b660b0c7fb434deeeccc86e1472"}
May 26 06:57:19.572077 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.572048    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t8jb" event={"ID":"65da128f-a9a9-4330-ae51-b544ae698a52","Type":"ContainerStarted","Data":"c894549161bf4d0abf8a3f867881b8fbe73a756041575a2f52ecea16564be110"}
May 26 06:57:19.573259 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.573228    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="e644dc8f30a05afc05949ccd1fcdb85ab0e83c1e434227c44ffab9fd1233649b" exitCode=0
May 26 06:57:19.573343 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.573309    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"e644dc8f30a05afc05949ccd1fcdb85ab0e83c1e434227c44ffab9fd1233649b"}
May 26 06:57:19.574615 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.574597    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqr8g" event={"ID":"021f0595-5f2e-41c3-9153-b90de710024d","Type":"ContainerStarted","Data":"b0a2a0ed70a74aeb4f6bb71bd5799802b44814021a37fa1b6a3a6c8acd5085f8"}
May 26 06:57:19.575776 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.575747    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-295qq" event={"ID":"6b1ff199-6dc2-4b3a-bb13-bd873600f564","Type":"ContainerStarted","Data":"0dd824ba6da68549f37a6e113eaf705328a41ec144e896263de10d1eb4c52904"}
May 26 06:57:19.576985 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.576960    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m" event={"ID":"e5a01383-3062-4834-a2a7-f44acf0dc101","Type":"ContainerStarted","Data":"6b9583d7918fb989d11f0f0659b1f0598fda30d71632fdd0fb2fabc43b5e91cc"}
May 26 06:57:19.586006 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.585971    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wlbl6" podStartSLOduration=3.584401218 podStartE2EDuration="21.585961803s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.041875919 +0000 UTC m=+3.262730315" lastFinishedPulling="2026-05-26 06:57:19.043436502 +0000 UTC m=+21.264290900" observedRunningTime="2026-05-26 06:57:19.585575564 +0000 UTC m=+21.806429969" watchObservedRunningTime="2026-05-26 06:57:19.585961803 +0000 UTC m=+21.806816207"
May 26 06:57:19.649122 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.649080    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qj4kf" podStartSLOduration=3.508839298 podStartE2EDuration="21.649066656s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.039497886 +0000 UTC m=+3.260352283" lastFinishedPulling="2026-05-26 06:57:19.179725251 +0000 UTC m=+21.400579641" observedRunningTime="2026-05-26 06:57:19.649018994 +0000 UTC m=+21.869873402" watchObservedRunningTime="2026-05-26 06:57:19.649066656 +0000 UTC m=+21.869921062"
May 26 06:57:19.649342 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.649322    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9t8jb" podStartSLOduration=3.643733269 podStartE2EDuration="21.649316142s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.037915312 +0000 UTC m=+3.258769695" lastFinishedPulling="2026-05-26 06:57:19.043498171 +0000 UTC m=+21.264352568" observedRunningTime="2026-05-26 06:57:19.629434506 +0000 UTC m=+21.850288912" watchObservedRunningTime="2026-05-26 06:57:19.649316142 +0000 UTC m=+21.870170547"
May 26 06:57:19.667937 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:19.667905    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqr8g" podStartSLOduration=3.643334032 podStartE2EDuration="21.667896099s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.036775723 +0000 UTC m=+3.257630106" lastFinishedPulling="2026-05-26 06:57:19.061337775 +0000 UTC m=+21.282192173" observedRunningTime="2026-05-26 06:57:19.667334799 +0000 UTC m=+21.888189205" watchObservedRunningTime="2026-05-26 06:57:19.667896099 +0000 UTC m=+21.888750501"
May 26 06:57:20.445867 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.445786    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:20.446015 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.445790    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:20.446075 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:20.446026    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:20.446075 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.445787    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:20.446153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:20.445898    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:20.446153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:20.446125    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:20.582560 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.582534    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 06:57:20.583045 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583021    2552 generic.go:358] "Generic (PLEG): container finished" podID="9e808798-a262-4a85-bcf5-98ba8f0abdad" containerID="8ab759672b54f7eab4674b4fc13282c2d155929759a0ae1d453e6b9e2f7ac900" exitCode=1
May 26 06:57:20.583152 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583111    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"ac4f88d14802534cc64faa30c7a4dbcb7e1e0e238df788899c8c35231e7129e2"}
May 26 06:57:20.583210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583151    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"781a399031f5e059551c98572b88aef11aafc546f8f39e68cc46e8b5becb4682"}
May 26 06:57:20.583210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583167    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"7ad71e0b5d8bf56fa491e4e41267e5c154d609df936b1acd6fad5c86c7884765"}
May 26 06:57:20.583210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583184    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerDied","Data":"8ab759672b54f7eab4674b4fc13282c2d155929759a0ae1d453e6b9e2f7ac900"}
May 26 06:57:20.583210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.583202    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"fa419e2aaad70d936ef57a3e8da059b5b89fbd7f4e1988e6ecbfe6e88fb7a71d"}
May 26 06:57:20.709063 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:20.708878    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 06:57:21.380565 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.380422    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T06:57:20.709057422Z","UUID":"be8595ff-1457-47a9-ba62-d00bf1753cb7","Handler":null,"Name":"","Endpoint":""}
May 26 06:57:21.382417 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.382377    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 06:57:21.382417 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.382416    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 06:57:21.587305 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.587272    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m" event={"ID":"e5a01383-3062-4834-a2a7-f44acf0dc101","Type":"ContainerStarted","Data":"92d345169267871b90be5f6b83f114c197df5bf5be4efe7ed599c879f093bacf"}
May 26 06:57:21.589825 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.589801    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 06:57:21.590176 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.590147    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"8de5ca38443d898c2fdeccb12682a9441909a0076f35f05dd4514fe798a504ad"}
May 26 06:57:21.591575 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.591553    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tq2pr" event={"ID":"9f40c1a0-07af-4b20-80f1-05fd197eaa64","Type":"ContainerStarted","Data":"824fa88941632369335883d7a2683e300aaa7bf23f5a214a86ce06785e3aee77"}
May 26 06:57:21.608815 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.608779    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-295qq" podStartSLOduration=5.576781675 podStartE2EDuration="23.608767615s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.033210881 +0000 UTC m=+3.254065267" lastFinishedPulling="2026-05-26 06:57:19.065196809 +0000 UTC m=+21.286051207" observedRunningTime="2026-05-26 06:57:19.687992722 +0000 UTC m=+21.908847124" watchObservedRunningTime="2026-05-26 06:57:21.608767615 +0000 UTC m=+23.829622002"
May 26 06:57:21.609327 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:21.609302    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tq2pr" podStartSLOduration=5.590191602 podStartE2EDuration="23.609295225s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.042233389 +0000 UTC m=+3.263087785" lastFinishedPulling="2026-05-26 06:57:19.061337011 +0000 UTC m=+21.282191408" observedRunningTime="2026-05-26 06:57:21.609051315 +0000 UTC m=+23.829905720" watchObservedRunningTime="2026-05-26 06:57:21.609295225 +0000 UTC m=+23.830149629"
May 26 06:57:22.445963 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.445928    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:22.446144 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.445928    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:22.446144 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:22.446052    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:22.446144 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.445933    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:22.446301 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:22.446140    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:22.446301 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:22.446194    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:22.595178 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.595139    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m" event={"ID":"e5a01383-3062-4834-a2a7-f44acf0dc101","Type":"ContainerStarted","Data":"96a4531d35b75207ec1b6af74bbbe3c65ab33143eb58c623e88a0b20ccde805d"}
May 26 06:57:22.604242 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.604216    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:22.604354 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:22.604330    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:57:22.604420 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:22.604408    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret podName:d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:38.604379718 +0000 UTC m=+40.825234100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret") pod "global-pull-secret-syncer-w9jkq" (UID: "d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6") : object "kube-system"/"original-pull-secret" not registered
May 26 06:57:22.612117 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:22.612075    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56z4m" podStartSLOduration=3.980888287 podStartE2EDuration="24.612063536s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.036789118 +0000 UTC m=+3.257643518" lastFinishedPulling="2026-05-26 06:57:21.667964379 +0000 UTC m=+23.888818767" observedRunningTime="2026-05-26 06:57:22.612014336 +0000 UTC m=+24.832868744" watchObservedRunningTime="2026-05-26 06:57:22.612063536 +0000 UTC m=+24.832917938"
May 26 06:57:23.158744 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:23.158716    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:23.159362 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:23.159343    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:23.597597 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:23.597523    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:23.598136 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:23.597797    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9t8jb"
May 26 06:57:24.445626 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.445600    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:24.445626 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.445612    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:24.445827 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.445606    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:24.445827 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:24.445691    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:24.445827 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:24.445755    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:24.445827 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:24.445813    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:24.601654 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.601632    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 06:57:24.602154 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.601971    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"81cfa7cdc9bd0eb55890bd36d091495faec2163f2373a567499c5f14a7c6f55e"}
May 26 06:57:24.603433 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.603413    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="82e357e6718094dd126c614ebe9ffa0587f429c390ddaa4debed6dcf8853c344" exitCode=0
May 26 06:57:24.603554 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:24.603501    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"82e357e6718094dd126c614ebe9ffa0587f429c390ddaa4debed6dcf8853c344"}
May 26 06:57:25.607180 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:25.607150    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="2495e144e35c10997f1ca94f7bc597b93f6c85d83848dde70e806c5388efbf65" exitCode=0
May 26 06:57:25.607496 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:25.607198    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"2495e144e35c10997f1ca94f7bc597b93f6c85d83848dde70e806c5388efbf65"}
May 26 06:57:26.446112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.445888    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:26.446262 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.445890    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:26.446262 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:26.446206    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:26.446339 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:26.446259    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:26.446339 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.445888    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:26.446431 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:26.446369    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:26.611230 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.611206    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 06:57:26.611660 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.611525    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"0a86b788e019359945fc6a993d9c3d79db61634c67bbd6afde6187c10d0da68a"}
May 26 06:57:26.611844 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.611824    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:26.611934 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.611880    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:26.612014 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.611993    2552 scope.go:117] "RemoveContainer" containerID="8ab759672b54f7eab4674b4fc13282c2d155929759a0ae1d453e6b9e2f7ac900"
May 26 06:57:26.615529 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.615503    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="d01c9e5e16ac31be42650cd85d14fca669c551a25880f4d933490d72347e04e4" exitCode=0
May 26 06:57:26.615644 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.615563    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"d01c9e5e16ac31be42650cd85d14fca669c551a25880f4d933490d72347e04e4"}
May 26 06:57:26.632494 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:26.632478    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:27.621584 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:27.621555    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 06:57:27.621991 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:27.621954    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" event={"ID":"9e808798-a262-4a85-bcf5-98ba8f0abdad","Type":"ContainerStarted","Data":"05182bfdf570521b61d11d36fc3a9348ac98cce0b4988d31abedcbd184bb7754"}
May 26 06:57:27.622260 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:27.622237    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:27.639681 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:27.639656    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:57:27.651872 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:27.651822    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn" podStartSLOduration=10.961224219 podStartE2EDuration="29.651807786s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.035001284 +0000 UTC m=+3.255855674" lastFinishedPulling="2026-05-26 06:57:19.725584855 +0000 UTC m=+21.946439241" observedRunningTime="2026-05-26 06:57:27.651505657 +0000 UTC m=+29.872360074" watchObservedRunningTime="2026-05-26 06:57:27.651807786 +0000 UTC m=+29.872662193"
May 26 06:57:28.317325 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.316883    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9jkq"]
May 26 06:57:28.317325 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.317201    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:28.317590 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:28.317321    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:28.320496 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.320209    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wthnw"]
May 26 06:57:28.320496 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.320330    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:28.320496 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:28.320448    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:28.320995 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.320771    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgmwn"]
May 26 06:57:28.320995 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:28.320870    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:28.320995 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:28.320955    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:29.445968 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:29.445935    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:29.446539 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:29.446078    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:30.445709 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:30.445618    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:30.445959 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:30.445756    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:30.445959 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:30.445808    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:30.445959 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:30.445918    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:31.445887 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:31.445853    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:31.446075 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:31.445975    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:57:32.074751 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:32.074715    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:32.074918 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.074890    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:32.074976 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.074965    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:58:04.074946864 +0000 UTC m=+66.295801267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:57:32.175336 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:32.175299    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:32.175539 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.175453    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:57:32.175539 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.175470    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:57:32.175539 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.175482    2552 projected.go:194] Error preparing data for projected volume kube-api-access-p2gdv for pod openshift-network-diagnostics/network-check-target-zgmwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:32.175539 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.175540    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv podName:9e7c1818-785e-45ce-a9a4-b67b9c306172 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:04.175526369 +0000 UTC m=+66.396380763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2gdv" (UniqueName: "kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv") pod "network-check-target-zgmwn" (UID: "9e7c1818-785e-45ce-a9a4-b67b9c306172") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:57:32.444988 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:32.444960    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:32.445131 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:32.444960    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:32.445131 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.445061    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9jkq" podUID="d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6"
May 26 06:57:32.445131 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:32.445123    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgmwn" podUID="9e7c1818-785e-45ce-a9a4-b67b9c306172"
May 26 06:57:33.093380 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.093309    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-78.ec2.internal" event="NodeReady"
May 26 06:57:33.093811 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.093464    2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 06:57:33.127988 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.127959    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 06:57:33.149145 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.149114    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vnsp7"]
May 26 06:57:33.149286 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.149265    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.154371 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.152376    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 06:57:33.154371 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.152439    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 06:57:33.154371 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.152695    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 06:57:33.154371 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.152921    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m4kvk\""
May 26 06:57:33.158619 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.158596    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 06:57:33.165202 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.165183    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svwdf"]
May 26 06:57:33.165319 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.165304    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.167707 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.167687    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2vh\""
May 26 06:57:33.167806 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.167709    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 06:57:33.167806 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.167693    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 06:57:33.167806 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.167687    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 06:57:33.187347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.187325    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 06:57:33.187452 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.187412    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnsp7"]
May 26 06:57:33.187452 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.187431    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwdf"]
May 26 06:57:33.187452 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.187446    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.189591 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.189578    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 06:57:33.189875 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.189861    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2jnx6\""
May 26 06:57:33.190002 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.189988    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 06:57:33.283369 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283344    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283483 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283483 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283451    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283591 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283506    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjgp\" (UniqueName: \"kubernetes.io/projected/01559bcd-c178-493e-b3ed-712f265af495-kube-api-access-dnjgp\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.283591 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283560    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283687 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283594    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45f9bc59-dc37-4a7e-8f57-80687171002b-config-volume\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.283687 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283620    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45f9bc59-dc37-4a7e-8f57-80687171002b-tmp-dir\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.283687 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283650    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283776 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.283776 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmtt\" (UniqueName: \"kubernetes.io/projected/45f9bc59-dc37-4a7e-8f57-80687171002b-kube-api-access-gkmtt\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.283776 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283771    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283896 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283789    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283896 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkbmw\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.283896 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.283821    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.384919 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.384900    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjgp\" (UniqueName: \"kubernetes.io/projected/01559bcd-c178-493e-b3ed-712f265af495-kube-api-access-dnjgp\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.385012 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.384926    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385012 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.384947    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45f9bc59-dc37-4a7e-8f57-80687171002b-config-volume\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385012 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.384962    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45f9bc59-dc37-4a7e-8f57-80687171002b-tmp-dir\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385039    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:33.385153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385052    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:33.385153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385098    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:33.885080157 +0000 UTC m=+36.105934552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:33.385153 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385113    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385162    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385179    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmtt\" (UniqueName: \"kubernetes.io/projected/45f9bc59-dc37-4a7e-8f57-80687171002b-kube-api-access-gkmtt\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385180    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45f9bc59-dc37-4a7e-8f57-80687171002b-tmp-dir\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385196    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385228    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385253    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385254    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkbmw\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385280    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385296    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:33.885285174 +0000 UTC m=+36.106139557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385325    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385347 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385350    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:33.385886 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.385419    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:57:33.885382532 +0000 UTC m=+36.106236919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:33.385886 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385353    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385886 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385454    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.385886 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385592    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45f9bc59-dc37-4a7e-8f57-80687171002b-config-volume\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.385886 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385753    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.386047 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.385989    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.386198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.386181    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.388887 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.388769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.388954 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.388834    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.393293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.393251    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.393431 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.393381    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmtt\" (UniqueName: \"kubernetes.io/projected/45f9bc59-dc37-4a7e-8f57-80687171002b-kube-api-access-gkmtt\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.393646 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.393624    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjgp\" (UniqueName: \"kubernetes.io/projected/01559bcd-c178-493e-b3ed-712f265af495-kube-api-access-dnjgp\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.393925 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.393909    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkbmw\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.445712 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.445694    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:57:33.447929 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.447910    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:57:33.447993 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.447981    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph2b6\""
May 26 06:57:33.635764 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.635679    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="c1c5e5f6c2d0d9d17d29654117d6383c0baac385d99d03a3daedc17d797c2a26" exitCode=0
May 26 06:57:33.635764 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.635717    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"c1c5e5f6c2d0d9d17d29654117d6383c0baac385d99d03a3daedc17d797c2a26"}
May 26 06:57:33.889566 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.889500    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:33.889566 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.889535    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:33.889708 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889641    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:33.889708 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889644    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:33.889708 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889692    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.889674517 +0000 UTC m=+37.110528910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:33.889708 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:33.889694    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:33.889899 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889706    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.889700437 +0000 UTC m=+37.110554819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:33.889899 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889794    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:33.889899 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889805    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:33.889899 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:33.889849    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:34.889836356 +0000 UTC m=+37.110690742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:34.445159 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.445125    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:34.445564 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.445125    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:57:34.448117 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.448092    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:57:34.448255 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.448147    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59vdl\""
May 26 06:57:34.448255 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.448196    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 06:57:34.448800 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.448785    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:57:34.639593 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.639556    2552 generic.go:358] "Generic (PLEG): container finished" podID="3416211a-32ce-4924-a1c4-f7a52c7e6494" containerID="e2815986b7ad0c4cd631380d926a8898a646d4694bbf200ada4ede2c0c0dafc6" exitCode=0
May 26 06:57:34.639710 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.639608    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerDied","Data":"e2815986b7ad0c4cd631380d926a8898a646d4694bbf200ada4ede2c0c0dafc6"}
May 26 06:57:34.898648 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.898615    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:34.898648 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.898657    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898742    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898744    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898802    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:57:36.898784431 +0000 UTC m=+39.119638831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:34.898822    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898857    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:36.898844743 +0000 UTC m=+39.119699144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898906    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898916    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:34.899147 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:34.898947    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:36.89893783 +0000 UTC m=+39.119792235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:35.644551 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:35.644516    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" event={"ID":"3416211a-32ce-4924-a1c4-f7a52c7e6494","Type":"ContainerStarted","Data":"a7ad6af75696f5495e6507699b4dddab3c5ac3b2c6e8b102dd23073a9eadab15"}
May 26 06:57:35.668772 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:35.668727    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fzxs6" podStartSLOduration=6.01389543 podStartE2EDuration="37.668713561s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:57:01.030661977 +0000 UTC m=+3.251516375" lastFinishedPulling="2026-05-26 06:57:32.68548012 +0000 UTC m=+34.906334506" observedRunningTime="2026-05-26 06:57:35.667218148 +0000 UTC m=+37.888072555" watchObservedRunningTime="2026-05-26 06:57:35.668713561 +0000 UTC m=+37.889567965"
May 26 06:57:36.913856 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:36.913814    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:36.913894    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:36.913925    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.913956    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.913972    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.914030    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:40.91401075 +0000 UTC m=+43.134865151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.914032    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.914049    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.914084    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:40.91407066 +0000 UTC m=+43.134925043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:36.914229 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:36.914102    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:57:40.914093408 +0000 UTC m=+43.134947791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:38.626594 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:38.626559    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:38.629447 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:38.629426    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6-original-pull-secret\") pod \"global-pull-secret-syncer-w9jkq\" (UID: \"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6\") " pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:38.654807 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:38.654785    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9jkq"
May 26 06:57:38.838298 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:38.838254    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9jkq"]
May 26 06:57:38.841742 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:57:38.841716    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cd77e4_fc28_4572_89bc_4e2abe3e4ef6.slice/crio-ef675df61dfa86a833c37e6d8b42c0450f5776b6aefd687facf9435d20b9f8e1 WatchSource:0}: Error finding container ef675df61dfa86a833c37e6d8b42c0450f5776b6aefd687facf9435d20b9f8e1: Status 404 returned error can't find the container with id ef675df61dfa86a833c37e6d8b42c0450f5776b6aefd687facf9435d20b9f8e1
May 26 06:57:39.651633 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:39.651594    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9jkq" event={"ID":"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6","Type":"ContainerStarted","Data":"ef675df61dfa86a833c37e6d8b42c0450f5776b6aefd687facf9435d20b9f8e1"}
May 26 06:57:40.945431 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:40.945376    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:40.945468    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:40.945498    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945562    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945587    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945590    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945654    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:57:48.945634909 +0000 UTC m=+51.166489297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945663    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945667    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:57:48.945661179 +0000 UTC m=+51.166515562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:40.945824 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:40.945728    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:57:48.945709169 +0000 UTC m=+51.166563559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:43.659533 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:43.659498    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9jkq" event={"ID":"d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6","Type":"ContainerStarted","Data":"1588dc95623185821c8038855e90ef11a709d45f868a599e2bc24641d4e051f8"}
May 26 06:57:43.673620 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:43.673578    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w9jkq" podStartSLOduration=33.545773416 podStartE2EDuration="37.673565945s" podCreationTimestamp="2026-05-26 06:57:06 +0000 UTC" firstStartedPulling="2026-05-26 06:57:38.843725532 +0000 UTC m=+41.064579914" lastFinishedPulling="2026-05-26 06:57:42.971518056 +0000 UTC m=+45.192372443" observedRunningTime="2026-05-26 06:57:43.673311003 +0000 UTC m=+45.894165409" watchObservedRunningTime="2026-05-26 06:57:43.673565945 +0000 UTC m=+45.894420349"
May 26 06:57:49.004767 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:49.004730    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:57:49.004767 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:49.004770    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:49.004807    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004889    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004951    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:05.004934956 +0000 UTC m=+67.225789339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004895    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004971    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004896    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.004994    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:58:05.004986621 +0000 UTC m=+67.225841003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:57:49.005355 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:57:49.005053    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:58:05.005039926 +0000 UTC m=+67.225894309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:57:59.636762 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:57:59.636734    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6d6fn"
May 26 06:58:04.110339 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.110293    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:58:04.113102 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.113082    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:58:04.121144 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:04.121123    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:58:04.121275 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:04.121263    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 06:59:08.121243453 +0000 UTC m=+130.342097840 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : secret "metrics-daemon-secret" not found
May 26 06:58:04.210915 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.210877    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:58:04.213824 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.213801    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:58:04.223544 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.223522    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:58:04.234144 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.234116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gdv\" (UniqueName: \"kubernetes.io/projected/9e7c1818-785e-45ce-a9a4-b67b9c306172-kube-api-access-p2gdv\") pod \"network-check-target-zgmwn\" (UID: \"9e7c1818-785e-45ce-a9a4-b67b9c306172\") " pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:58:04.461966 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.461888    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59vdl\""
May 26 06:58:04.469847 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.469831    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:58:04.598084 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.598053    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgmwn"]
May 26 06:58:04.601307 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:58:04.601280    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7c1818_785e_45ce_a9a4_b67b9c306172.slice/crio-32d6b1f0464f238a1e3c65346661b3f45f5097249b62e0b78c76c434abead200 WatchSource:0}: Error finding container 32d6b1f0464f238a1e3c65346661b3f45f5097249b62e0b78c76c434abead200: Status 404 returned error can't find the container with id 32d6b1f0464f238a1e3c65346661b3f45f5097249b62e0b78c76c434abead200
May 26 06:58:04.700106 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:04.700076    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgmwn" event={"ID":"9e7c1818-785e-45ce-a9a4-b67b9c306172","Type":"ContainerStarted","Data":"32d6b1f0464f238a1e3c65346661b3f45f5097249b62e0b78c76c434abead200"}
May 26 06:58:05.019252 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:05.019213    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:58:05.019448 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:05.019274    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:58:05.019448 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:05.019302    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:58:05.019448 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019375    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:58:05.019448 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019423    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:58:05.019635 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019462    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:58:37.019445184 +0000 UTC m=+99.240299580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:58:05.019635 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019378    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:58:05.019635 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019499    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:58:05.019635 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019484    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:58:37.019469848 +0000 UTC m=+99.240324235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:58:05.019635 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:05.019562    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:58:37.01954505 +0000 UTC m=+99.240399435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:58:07.707838 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:07.707803    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgmwn" event={"ID":"9e7c1818-785e-45ce-a9a4-b67b9c306172","Type":"ContainerStarted","Data":"0c17d1f5fd7a738543b27d4bd38b894b6c8cdc5aca62885f5346a977b9430cfd"}
May 26 06:58:07.708192 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:07.707951    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:58:07.725050 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:07.724946    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zgmwn" podStartSLOduration=67.056747928 podStartE2EDuration="1m9.724930986s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 06:58:04.603184379 +0000 UTC m=+66.824038763" lastFinishedPulling="2026-05-26 06:58:07.271367439 +0000 UTC m=+69.492221821" observedRunningTime="2026-05-26 06:58:07.724270515 +0000 UTC m=+69.945124919" watchObservedRunningTime="2026-05-26 06:58:07.724930986 +0000 UTC m=+69.945785403"
May 26 06:58:37.037943 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:37.037912    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:37.037960    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:37.037985    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038081    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038085    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038090    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038100    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7485b9db8d-2zgtm: secret "image-registry-tls" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038158    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls podName:c1456a7b-20d9-4bce-9576-611713e4017a nodeName:}" failed. No retries permitted until 2026-05-26 06:59:41.038138421 +0000 UTC m=+163.258992817 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls") pod "image-registry-7485b9db8d-2zgtm" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a") : secret "image-registry-tls" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038174    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls podName:45f9bc59-dc37-4a7e-8f57-80687171002b nodeName:}" failed. No retries permitted until 2026-05-26 06:59:41.038167194 +0000 UTC m=+163.259021577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls") pod "dns-default-svwdf" (UID: "45f9bc59-dc37-4a7e-8f57-80687171002b") : secret "dns-default-metrics-tls" not found
May 26 06:58:37.038498 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:58:37.038183    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert podName:01559bcd-c178-493e-b3ed-712f265af495 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:41.038178093 +0000 UTC m=+163.259032475 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert") pod "ingress-canary-vnsp7" (UID: "01559bcd-c178-493e-b3ed-712f265af495") : secret "canary-serving-cert" not found
May 26 06:58:38.711883 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:58:38.711857    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zgmwn"
May 26 06:59:08.148067 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:08.148036    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:59:08.148544 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:08.148153    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:59:08.148544 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:08.148206    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs podName:2c3534cd-da84-4818-ab24-378f8ebef1fe nodeName:}" failed. No retries permitted until 2026-05-26 07:01:10.148191961 +0000 UTC m=+252.369046345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs") pod "network-metrics-daemon-wthnw" (UID: "2c3534cd-da84-4818-ab24-378f8ebef1fe") : secret "metrics-daemon-secret" not found
May 26 06:59:20.489072 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.489041    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"]
May 26 06:59:20.490660 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.490644    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"
May 26 06:59:20.492869 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.492846    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zwx4d\""
May 26 06:59:20.506106 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.506081    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"]
May 26 06:59:20.508110 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.508091    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lmcnl"]
May 26 06:59:20.508275 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.508258    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.509833 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.509809    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"]
May 26 06:59:20.509938 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.509911    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.521384 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.521365    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 06:59:20.521655 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.521635    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 06:59:20.521748 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.521668    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 26 06:59:20.521748 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.521690    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t5cbh\""
May 26 06:59:20.521748 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.521668    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 06:59:20.522210 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.522198    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 26 06:59:20.522312 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.522301    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vl724\""
May 26 06:59:20.522352 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.522324    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 26 06:59:20.523215 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.523200    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 26 06:59:20.524939 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.524921    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"]
May 26 06:59:20.532458 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.531732    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 26 06:59:20.534451 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.534433    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lmcnl"]
May 26 06:59:20.586936 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.586910    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"]
May 26 06:59:20.588626 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.588612    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.594677 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.594663    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 26 06:59:20.595487 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.595470    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 26 06:59:20.595714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.595699    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mpd69\""
May 26 06:59:20.597215 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.597199    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 26 06:59:20.597330 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.597315    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 26 06:59:20.620014 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.619994    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"]
May 26 06:59:20.631511 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631487    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcj9p\" (UniqueName: \"kubernetes.io/projected/94c4fada-385b-492e-8d9f-370cfcece98f-kube-api-access-wcj9p\") pod \"network-check-source-7f44b6dd87-bq4sw\" (UID: \"94c4fada-385b-492e-8d9f-370cfcece98f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"
May 26 06:59:20.631606 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631519    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-trusted-ca\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.631606 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631556    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4nrb\" (UniqueName: \"kubernetes.io/projected/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-kube-api-access-m4nrb\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.631694 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631628    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-serving-cert\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.631694 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631672    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-config\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.631768 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631701    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnjg\" (UniqueName: \"kubernetes.io/projected/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-kube-api-access-9cnjg\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.631768 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.631741    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.732730 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732708    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4nrb\" (UniqueName: \"kubernetes.io/projected/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-kube-api-access-m4nrb\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.732812 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732741    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-serving-cert\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.732812 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732761    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-config\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.732812 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732785    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnjg\" (UniqueName: \"kubernetes.io/projected/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-kube-api-access-9cnjg\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.732919 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732884    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.732956 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.732930    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sfw\" (UniqueName: \"kubernetes.io/projected/ca413db1-14bb-450c-83d2-3dd72ce54e80-kube-api-access-k8sfw\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.733022 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733007    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcj9p\" (UniqueName: \"kubernetes.io/projected/94c4fada-385b-492e-8d9f-370cfcece98f-kube-api-access-wcj9p\") pod \"network-check-source-7f44b6dd87-bq4sw\" (UID: \"94c4fada-385b-492e-8d9f-370cfcece98f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"
May 26 06:59:20.733060 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733039    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-trusted-ca\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.733060 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:20.733053    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 06:59:20.733153 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733068    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca413db1-14bb-450c-83d2-3dd72ce54e80-serving-cert\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.733153 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733092    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca413db1-14bb-450c-83d2-3dd72ce54e80-config\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.733153 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:20.733129    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls podName:ca4634b1-9e26-44c7-9e7f-c52e41ed83d8 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:21.233106324 +0000 UTC m=+143.453960720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls") pod "cluster-samples-operator-697587599-hvp6s" (UID: "ca4634b1-9e26-44c7-9e7f-c52e41ed83d8") : secret "samples-operator-tls" not found
May 26 06:59:20.733374 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733357    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-config\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.733694 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.733678    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-trusted-ca\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.735162 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.735141    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-serving-cert\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.743370 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.743321    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnjg\" (UniqueName: \"kubernetes.io/projected/cb89c7ef-42ce-4f70-b6d8-71ae862f40b9-kube-api-access-9cnjg\") pod \"console-operator-76dff48d59-lmcnl\" (UID: \"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9\") " pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.743559 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.743542    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4nrb\" (UniqueName: \"kubernetes.io/projected/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-kube-api-access-m4nrb\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:20.743705 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.743686    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcj9p\" (UniqueName: \"kubernetes.io/projected/94c4fada-385b-492e-8d9f-370cfcece98f-kube-api-access-wcj9p\") pod \"network-check-source-7f44b6dd87-bq4sw\" (UID: \"94c4fada-385b-492e-8d9f-370cfcece98f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"
May 26 06:59:20.799041 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.799020    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"
May 26 06:59:20.821977 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.821954    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:20.834199 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.834106    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca413db1-14bb-450c-83d2-3dd72ce54e80-serving-cert\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.834199 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.834141    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca413db1-14bb-450c-83d2-3dd72ce54e80-config\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.834474 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.834451    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sfw\" (UniqueName: \"kubernetes.io/projected/ca413db1-14bb-450c-83d2-3dd72ce54e80-kube-api-access-k8sfw\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.834732 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.834707    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca413db1-14bb-450c-83d2-3dd72ce54e80-config\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.836824 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.836803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca413db1-14bb-450c-83d2-3dd72ce54e80-serving-cert\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.844840 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.844815    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sfw\" (UniqueName: \"kubernetes.io/projected/ca413db1-14bb-450c-83d2-3dd72ce54e80-kube-api-access-k8sfw\") pod \"service-ca-operator-57b5b68b8-664k5\" (UID: \"ca413db1-14bb-450c-83d2-3dd72ce54e80\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.896871 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.896840    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"
May 26 06:59:20.930112 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.930081    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw"]
May 26 06:59:20.933391 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:20.933363    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c4fada_385b_492e_8d9f_370cfcece98f.slice/crio-3bb499880f4ffafee0df16d81932cf633358ecc6042850ddc57b5356b3957f46 WatchSource:0}: Error finding container 3bb499880f4ffafee0df16d81932cf633358ecc6042850ddc57b5356b3957f46: Status 404 returned error can't find the container with id 3bb499880f4ffafee0df16d81932cf633358ecc6042850ddc57b5356b3957f46
May 26 06:59:20.950068 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:20.950021    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lmcnl"]
May 26 06:59:20.959093 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:20.958765    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb89c7ef_42ce_4f70_b6d8_71ae862f40b9.slice/crio-235cefdc6c80408b73283f83e297ece1861ec5fa4fe655a5a7bc0abdcb1e507f WatchSource:0}: Error finding container 235cefdc6c80408b73283f83e297ece1861ec5fa4fe655a5a7bc0abdcb1e507f: Status 404 returned error can't find the container with id 235cefdc6c80408b73283f83e297ece1861ec5fa4fe655a5a7bc0abdcb1e507f
May 26 06:59:21.020879 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.020807    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5"]
May 26 06:59:21.024905 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:21.024864    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca413db1_14bb_450c_83d2_3dd72ce54e80.slice/crio-7442debaed14856d46d0af6f3f20bdbc9dd0365f69a0b1bb3b721b91ffe96002 WatchSource:0}: Error finding container 7442debaed14856d46d0af6f3f20bdbc9dd0365f69a0b1bb3b721b91ffe96002: Status 404 returned error can't find the container with id 7442debaed14856d46d0af6f3f20bdbc9dd0365f69a0b1bb3b721b91ffe96002
May 26 06:59:21.236832 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.236806    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:21.236988 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:21.236968    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 06:59:21.237057 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:21.237047    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls podName:ca4634b1-9e26-44c7-9e7f-c52e41ed83d8 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:22.237030318 +0000 UTC m=+144.457884701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls") pod "cluster-samples-operator-697587599-hvp6s" (UID: "ca4634b1-9e26-44c7-9e7f-c52e41ed83d8") : secret "samples-operator-tls" not found
May 26 06:59:21.840315 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.840244    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw" event={"ID":"94c4fada-385b-492e-8d9f-370cfcece98f","Type":"ContainerStarted","Data":"a467f739c04b2267c83cc458fd1bf774571d6ed4bf5591051a88c7c41622d6a4"}
May 26 06:59:21.840315 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.840290    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw" event={"ID":"94c4fada-385b-492e-8d9f-370cfcece98f","Type":"ContainerStarted","Data":"3bb499880f4ffafee0df16d81932cf633358ecc6042850ddc57b5356b3957f46"}
May 26 06:59:21.842006 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.841927    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" event={"ID":"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9","Type":"ContainerStarted","Data":"235cefdc6c80408b73283f83e297ece1861ec5fa4fe655a5a7bc0abdcb1e507f"}
May 26 06:59:21.843169 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:21.843141    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5" event={"ID":"ca413db1-14bb-450c-83d2-3dd72ce54e80","Type":"ContainerStarted","Data":"7442debaed14856d46d0af6f3f20bdbc9dd0365f69a0b1bb3b721b91ffe96002"}
May 26 06:59:22.245581 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:22.245537    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:22.245792 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:22.245694    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 06:59:22.245792 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:22.245768    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls podName:ca4634b1-9e26-44c7-9e7f-c52e41ed83d8 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:24.245749809 +0000 UTC m=+146.466604211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls") pod "cluster-samples-operator-697587599-hvp6s" (UID: "ca4634b1-9e26-44c7-9e7f-c52e41ed83d8") : secret "samples-operator-tls" not found
May 26 06:59:23.852480 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.852456    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/0.log"
May 26 06:59:23.852854 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.852504    2552 generic.go:358] "Generic (PLEG): container finished" podID="cb89c7ef-42ce-4f70-b6d8-71ae862f40b9" containerID="5a89884e7217f8207c5536e0436551a2862ea7bb12da0af1604299dfb58a1dbd" exitCode=255
May 26 06:59:23.852854 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.852582    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" event={"ID":"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9","Type":"ContainerDied","Data":"5a89884e7217f8207c5536e0436551a2862ea7bb12da0af1604299dfb58a1dbd"}
May 26 06:59:23.852854 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.852833    2552 scope.go:117] "RemoveContainer" containerID="5a89884e7217f8207c5536e0436551a2862ea7bb12da0af1604299dfb58a1dbd"
May 26 06:59:23.853985 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.853956    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5" event={"ID":"ca413db1-14bb-450c-83d2-3dd72ce54e80","Type":"ContainerStarted","Data":"e15fc54f1ba68421b0d4c30aa21fd41d165560f1ffb8d457d1040c9543d668aa"}
May 26 06:59:23.870473 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.870425    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bq4sw" podStartSLOduration=3.870410304 podStartE2EDuration="3.870410304s" podCreationTimestamp="2026-05-26 06:59:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:59:21.857952058 +0000 UTC m=+144.078806464" watchObservedRunningTime="2026-05-26 06:59:23.870410304 +0000 UTC m=+146.091264703"
May 26 06:59:23.885318 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:23.885276    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5" podStartSLOduration=1.397237916 podStartE2EDuration="3.885264278s" podCreationTimestamp="2026-05-26 06:59:20 +0000 UTC" firstStartedPulling="2026-05-26 06:59:21.026665768 +0000 UTC m=+143.247520155" lastFinishedPulling="2026-05-26 06:59:23.514692134 +0000 UTC m=+145.735546517" observedRunningTime="2026-05-26 06:59:23.884887253 +0000 UTC m=+146.105741661" watchObservedRunningTime="2026-05-26 06:59:23.885264278 +0000 UTC m=+146.106118683"
May 26 06:59:24.262253 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.262170    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:24.262392 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:24.262311    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 06:59:24.262392 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:24.262379    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls podName:ca4634b1-9e26-44c7-9e7f-c52e41ed83d8 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:28.262362663 +0000 UTC m=+150.483217045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls") pod "cluster-samples-operator-697587599-hvp6s" (UID: "ca4634b1-9e26-44c7-9e7f-c52e41ed83d8") : secret "samples-operator-tls" not found
May 26 06:59:24.858151 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858122    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 06:59:24.858548 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858480    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/0.log"
May 26 06:59:24.858548 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858509    2552 generic.go:358] "Generic (PLEG): container finished" podID="cb89c7ef-42ce-4f70-b6d8-71ae862f40b9" containerID="f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d" exitCode=255
May 26 06:59:24.858627 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858601    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" event={"ID":"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9","Type":"ContainerDied","Data":"f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d"}
May 26 06:59:24.858673 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858637    2552 scope.go:117] "RemoveContainer" containerID="5a89884e7217f8207c5536e0436551a2862ea7bb12da0af1604299dfb58a1dbd"
May 26 06:59:24.858825 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:24.858793    2552 scope.go:117] "RemoveContainer" containerID="f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d"
May 26 06:59:24.859031 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:24.859009    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lmcnl_openshift-console-operator(cb89c7ef-42ce-4f70-b6d8-71ae862f40b9)\"" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" podUID="cb89c7ef-42ce-4f70-b6d8-71ae862f40b9"
May 26 06:59:25.862507 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:25.862478    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 06:59:25.862940 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:25.862851    2552 scope.go:117] "RemoveContainer" containerID="f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d"
May 26 06:59:25.863074 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:25.863051    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lmcnl_openshift-console-operator(cb89c7ef-42ce-4f70-b6d8-71ae862f40b9)\"" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" podUID="cb89c7ef-42ce-4f70-b6d8-71ae862f40b9"
May 26 06:59:27.192028 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:27.191997    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-295qq_6b1ff199-6dc2-4b3a-bb13-bd873600f564/dns-node-resolver/0.log"
May 26 06:59:28.292488 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:28.292447    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:28.292844 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:28.292574    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 06:59:28.292844 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:28.292635    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls podName:ca4634b1-9e26-44c7-9e7f-c52e41ed83d8 nodeName:}" failed. No retries permitted until 2026-05-26 06:59:36.292619532 +0000 UTC m=+158.513473921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls") pod "cluster-samples-operator-697587599-hvp6s" (UID: "ca4634b1-9e26-44c7-9e7f-c52e41ed83d8") : secret "samples-operator-tls" not found
May 26 06:59:28.592261 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:28.592185    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlbl6_c4293f84-219f-4096-9112-86b361db2d37/node-ca/0.log"
May 26 06:59:30.822217 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:30.822181    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:30.822217 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:30.822217    2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:30.822767 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:30.822650    2552 scope.go:117] "RemoveContainer" containerID="f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d"
May 26 06:59:30.822874 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:30.822848    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lmcnl_openshift-console-operator(cb89c7ef-42ce-4f70-b6d8-71ae862f40b9)\"" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" podUID="cb89c7ef-42ce-4f70-b6d8-71ae862f40b9"
May 26 06:59:36.163600 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:36.163555    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" podUID="c1456a7b-20d9-4bce-9576-611713e4017a"
May 26 06:59:36.172724 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:36.172696    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vnsp7" podUID="01559bcd-c178-493e-b3ed-712f265af495"
May 26 06:59:36.194858 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:36.194836    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-svwdf" podUID="45f9bc59-dc37-4a7e-8f57-80687171002b"
May 26 06:59:36.349767 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.349733    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:36.352172 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.352146    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca4634b1-9e26-44c7-9e7f-c52e41ed83d8-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hvp6s\" (UID: \"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:36.417535 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.417481    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"
May 26 06:59:36.453250 ip-10-0-133-78 kubenswrapper[2552]: E0526 06:59:36.453208    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wthnw" podUID="2c3534cd-da84-4818-ab24-378f8ebef1fe"
May 26 06:59:36.535877 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.535845    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s"]
May 26 06:59:36.888025 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.888000    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwdf"
May 26 06:59:36.888173 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.888021    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s" event={"ID":"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8","Type":"ContainerStarted","Data":"fe3dd102b4ef9f8c2630985394b888c26628a6f9d48ed0f6d2ee4b70548686c5"}
May 26 06:59:36.888173 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.888030    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:59:36.888173 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:36.888030    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:59:38.893987 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:38.893953    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s" event={"ID":"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8","Type":"ContainerStarted","Data":"329fb0d9c0002c1faadc3b133b98944eee23d3a2a7d0e4707e98b6bbc5b637ec"}
May 26 06:59:38.893987 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:38.893992    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s" event={"ID":"ca4634b1-9e26-44c7-9e7f-c52e41ed83d8","Type":"ContainerStarted","Data":"1b43dfd4d78f28ea2288b5a23fd6a63df036ab79e994e07b326be4d18a5f06b9"}
May 26 06:59:38.909590 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:38.909548    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hvp6s" podStartSLOduration=16.995158254 podStartE2EDuration="18.909535322s" podCreationTimestamp="2026-05-26 06:59:20 +0000 UTC" firstStartedPulling="2026-05-26 06:59:36.574352286 +0000 UTC m=+158.795206669" lastFinishedPulling="2026-05-26 06:59:38.488729341 +0000 UTC m=+160.709583737" observedRunningTime="2026-05-26 06:59:38.909223297 +0000 UTC m=+161.130077704" watchObservedRunningTime="2026-05-26 06:59:38.909535322 +0000 UTC m=+161.130389726"
May 26 06:59:41.081692 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.081658    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:59:41.082168 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.081706    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:59:41.082168 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.081759    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:59:41.084097 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.084074    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45f9bc59-dc37-4a7e-8f57-80687171002b-metrics-tls\") pod \"dns-default-svwdf\" (UID: \"45f9bc59-dc37-4a7e-8f57-80687171002b\") " pod="openshift-dns/dns-default-svwdf"
May 26 06:59:41.084207 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.084193    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"image-registry-7485b9db8d-2zgtm\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") " pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:59:41.084265 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.084210    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01559bcd-c178-493e-b3ed-712f265af495-cert\") pod \"ingress-canary-vnsp7\" (UID: \"01559bcd-c178-493e-b3ed-712f265af495\") " pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:59:41.092302 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.092279    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m4kvk\""
May 26 06:59:41.092421 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.092305    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2vh\""
May 26 06:59:41.092421 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.092286    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2jnx6\""
May 26 06:59:41.099459 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.099445    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwdf"
May 26 06:59:41.099521 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.099506    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnsp7"
May 26 06:59:41.099557 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.099534    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:59:41.239755 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.239722    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwdf"]
May 26 06:59:41.242464 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:41.242427    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f9bc59_dc37_4a7e_8f57_80687171002b.slice/crio-fe9e764cdd64a933e9b5ed5c5e36af9872f0fa1dda899524cd81e60d25b834f5 WatchSource:0}: Error finding container fe9e764cdd64a933e9b5ed5c5e36af9872f0fa1dda899524cd81e60d25b834f5: Status 404 returned error can't find the container with id fe9e764cdd64a933e9b5ed5c5e36af9872f0fa1dda899524cd81e60d25b834f5
May 26 06:59:41.259077 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.259057    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 06:59:41.261796 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:41.261749    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1456a7b_20d9_4bce_9576_611713e4017a.slice/crio-1697330369d0e954a245a87e2aab5f0e66b4a56303e5996431e7a0c689d1d3fb WatchSource:0}: Error finding container 1697330369d0e954a245a87e2aab5f0e66b4a56303e5996431e7a0c689d1d3fb: Status 404 returned error can't find the container with id 1697330369d0e954a245a87e2aab5f0e66b4a56303e5996431e7a0c689d1d3fb
May 26 06:59:41.274387 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.274363    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnsp7"]
May 26 06:59:41.278090 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:41.278059    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01559bcd_c178_493e_b3ed_712f265af495.slice/crio-6fd930fe5b7b6d39fd83c6cdf6471d5e169f5b2e72670b4df33a709cec99c62d WatchSource:0}: Error finding container 6fd930fe5b7b6d39fd83c6cdf6471d5e169f5b2e72670b4df33a709cec99c62d: Status 404 returned error can't find the container with id 6fd930fe5b7b6d39fd83c6cdf6471d5e169f5b2e72670b4df33a709cec99c62d
May 26 06:59:41.905177 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.905110    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" event={"ID":"c1456a7b-20d9-4bce-9576-611713e4017a","Type":"ContainerStarted","Data":"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"}
May 26 06:59:41.905177 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.905155    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" event={"ID":"c1456a7b-20d9-4bce-9576-611713e4017a","Type":"ContainerStarted","Data":"1697330369d0e954a245a87e2aab5f0e66b4a56303e5996431e7a0c689d1d3fb"}
May 26 06:59:41.905546 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.905223    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 06:59:41.906542 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.906516    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwdf" event={"ID":"45f9bc59-dc37-4a7e-8f57-80687171002b","Type":"ContainerStarted","Data":"fe9e764cdd64a933e9b5ed5c5e36af9872f0fa1dda899524cd81e60d25b834f5"}
May 26 06:59:41.907663 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.907627    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnsp7" event={"ID":"01559bcd-c178-493e-b3ed-712f265af495","Type":"ContainerStarted","Data":"6fd930fe5b7b6d39fd83c6cdf6471d5e169f5b2e72670b4df33a709cec99c62d"}
May 26 06:59:41.927331 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:41.927285    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" podStartSLOduration=165.927270104 podStartE2EDuration="2m45.927270104s" podCreationTimestamp="2026-05-26 06:56:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:59:41.925843503 +0000 UTC m=+164.146697909" watchObservedRunningTime="2026-05-26 06:59:41.927270104 +0000 UTC m=+164.148124512"
May 26 06:59:42.446056 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:42.446028    2552 scope.go:117] "RemoveContainer" containerID="f6ffc80811c2f71199a8763d31d1ca161e9b8581b7b1da5deb935a51917c088d"
May 26 06:59:43.914659 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.914621    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwdf" event={"ID":"45f9bc59-dc37-4a7e-8f57-80687171002b","Type":"ContainerStarted","Data":"4460d39e89078002e067c77a65b5a86536f05c29746e3033f8625051ba4df506"}
May 26 06:59:43.915145 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.914666    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwdf" event={"ID":"45f9bc59-dc37-4a7e-8f57-80687171002b","Type":"ContainerStarted","Data":"60d62fdf9ef877b56ec540ab026a45aadfe41237d1def5fa9def6806a040ff0a"}
May 26 06:59:43.915145 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.914766    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svwdf"
May 26 06:59:43.915925 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.915900    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnsp7" event={"ID":"01559bcd-c178-493e-b3ed-712f265af495","Type":"ContainerStarted","Data":"f0dbdbdb9b6c0588fa6e23b4a9158dcb4ad1f2c9d93673550c4415f116728d92"}
May 26 06:59:43.917405 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.917377    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 06:59:43.917488 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.917452    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" event={"ID":"cb89c7ef-42ce-4f70-b6d8-71ae862f40b9","Type":"ContainerStarted","Data":"810820eae450cda156106eae356a9b6c48575bac9ba4e2c25be3717db622dc67"}
May 26 06:59:43.917692 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.917676    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:43.932004 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.931965    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-svwdf" podStartSLOduration=129.111865193 podStartE2EDuration="2m10.931952158s" podCreationTimestamp="2026-05-26 06:57:33 +0000 UTC" firstStartedPulling="2026-05-26 06:59:41.245328391 +0000 UTC m=+163.466182774" lastFinishedPulling="2026-05-26 06:59:43.065415339 +0000 UTC m=+165.286269739" observedRunningTime="2026-05-26 06:59:43.930542487 +0000 UTC m=+166.151396890" watchObservedRunningTime="2026-05-26 06:59:43.931952158 +0000 UTC m=+166.152806635"
May 26 06:59:43.946573 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.946539    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl" podStartSLOduration=21.394371001 podStartE2EDuration="23.946529187s" podCreationTimestamp="2026-05-26 06:59:20 +0000 UTC" firstStartedPulling="2026-05-26 06:59:20.960605363 +0000 UTC m=+143.181459761" lastFinishedPulling="2026-05-26 06:59:23.512763565 +0000 UTC m=+145.733617947" observedRunningTime="2026-05-26 06:59:43.945345088 +0000 UTC m=+166.166199503" watchObservedRunningTime="2026-05-26 06:59:43.946529187 +0000 UTC m=+166.167383593"
May 26 06:59:43.959257 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:43.959219    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vnsp7" podStartSLOduration=129.171909201 podStartE2EDuration="2m10.959209303s" podCreationTimestamp="2026-05-26 06:57:33 +0000 UTC" firstStartedPulling="2026-05-26 06:59:41.280061753 +0000 UTC m=+163.500916139" lastFinishedPulling="2026-05-26 06:59:43.067361852 +0000 UTC m=+165.288216241" observedRunningTime="2026-05-26 06:59:43.958577966 +0000 UTC m=+166.179432371" watchObservedRunningTime="2026-05-26 06:59:43.959209303 +0000 UTC m=+166.180063752"
May 26 06:59:44.340987 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:44.340912    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-lmcnl"
May 26 06:59:47.446045 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:47.446009    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 06:59:48.240645 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.240613    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zjd4h"]
May 26 06:59:48.243532 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.243509    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.245688 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.245670    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 06:59:48.246643 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.246620    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 06:59:48.246747 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.246647    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 06:59:48.247153 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.247137    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 06:59:48.247248 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.247139    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jbx45\""
May 26 06:59:48.251546 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.251523    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-fz6cw"]
May 26 06:59:48.253358 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.253340    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 06:59:48.256894 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.256878    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 06:59:48.257042 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.257026    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 06:59:48.264754 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.264738    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zjd4h"]
May 26 06:59:48.264915 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.264902    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ksnmb\""
May 26 06:59:48.265945 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.265925    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 06:59:48.281760 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.281730    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fz6cw"]
May 26 06:59:48.336090 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336064    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64be458e-4094-41e1-be76-6db601002aa2-crio-socket\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.336243 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336141    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64be458e-4094-41e1-be76-6db601002aa2-data-volume\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.336243 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336172    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64be458e-4094-41e1-be76-6db601002aa2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.336243 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336211    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxrm\" (UniqueName: \"kubernetes.io/projected/64be458e-4094-41e1-be76-6db601002aa2-kube-api-access-8vxrm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.336372 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336282    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64be458e-4094-41e1-be76-6db601002aa2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.336372 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.336309    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm29z\" (UniqueName: \"kubernetes.io/projected/0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c-kube-api-access-mm29z\") pod \"downloads-57bd96b888-fz6cw\" (UID: \"0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c\") " pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 06:59:48.379256 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.379222    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55784c4fdb-pzzhw"]
May 26 06:59:48.381096 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.381081    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.397698 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.397676    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55784c4fdb-pzzhw"]
May 26 06:59:48.437439 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437412    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-image-registry-private-configuration\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437541 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437451    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxrm\" (UniqueName: \"kubernetes.io/projected/64be458e-4094-41e1-be76-6db601002aa2-kube-api-access-8vxrm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437541 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437472    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-trusted-ca\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437541 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437492    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-installation-pull-secrets\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437541 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437520    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64be458e-4094-41e1-be76-6db601002aa2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437541 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437541    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mm29z\" (UniqueName: \"kubernetes.io/projected/0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c-kube-api-access-mm29z\") pod \"downloads-57bd96b888-fz6cw\" (UID: \"0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c\") " pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437557    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64be458e-4094-41e1-be76-6db601002aa2-crio-socket\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437599    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-certificates\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437643    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-ca-trust-extracted\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437650    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64be458e-4094-41e1-be76-6db601002aa2-crio-socket\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437666    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-bound-sa-token\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437714 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xtsb\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-kube-api-access-6xtsb\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.437984 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437728    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64be458e-4094-41e1-be76-6db601002aa2-data-volume\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437984 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437854    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64be458e-4094-41e1-be76-6db601002aa2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.437984 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.437878    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-tls\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.438141 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.438017    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64be458e-4094-41e1-be76-6db601002aa2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.438141 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.438017    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64be458e-4094-41e1-be76-6db601002aa2-data-volume\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.440051 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.440028    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64be458e-4094-41e1-be76-6db601002aa2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.446494 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.446469    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxrm\" (UniqueName: \"kubernetes.io/projected/64be458e-4094-41e1-be76-6db601002aa2-kube-api-access-8vxrm\") pod \"insights-runtime-extractor-zjd4h\" (UID: \"64be458e-4094-41e1-be76-6db601002aa2\") " pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.446494 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.446484    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm29z\" (UniqueName: \"kubernetes.io/projected/0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c-kube-api-access-mm29z\") pod \"downloads-57bd96b888-fz6cw\" (UID: \"0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c\") " pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 06:59:48.538562 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538474    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-image-registry-private-configuration\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538562 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538517    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-trusted-ca\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538562 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538538    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-installation-pull-secrets\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538818 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538579    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-certificates\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538818 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538606    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-ca-trust-extracted\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538818 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538626    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-bound-sa-token\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.538818 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538779    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xtsb\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-kube-api-access-6xtsb\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.539026 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.538834    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-tls\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.539170 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.539144    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-ca-trust-extracted\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.539565 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.539545    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-certificates\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.539711 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.539688    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-trusted-ca\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.541127 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.541102    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-image-registry-private-configuration\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.541205 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.541102    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-installation-pull-secrets\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.541205 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.541164    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-registry-tls\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.546521 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.546491    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xtsb\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-kube-api-access-6xtsb\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.546617 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.546595    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4669bbd7-c56c-438f-a9a2-5ed5f5244c10-bound-sa-token\") pod \"image-registry-55784c4fdb-pzzhw\" (UID: \"4669bbd7-c56c-438f-a9a2-5ed5f5244c10\") " pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.553477 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.553459    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zjd4h"
May 26 06:59:48.561121 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.561081    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 06:59:48.689250 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.689223    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.703476 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.703437    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zjd4h"]
May 26 06:59:48.709086 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:48.709059    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64be458e_4094_41e1_be76_6db601002aa2.slice/crio-c2fc9bbbeba0d96dba6e44ccee9fe17c8cd875d526d8076886668402014d1d76 WatchSource:0}: Error finding container c2fc9bbbeba0d96dba6e44ccee9fe17c8cd875d526d8076886668402014d1d76: Status 404 returned error can't find the container with id c2fc9bbbeba0d96dba6e44ccee9fe17c8cd875d526d8076886668402014d1d76
May 26 06:59:48.720687 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.720666    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fz6cw"]
May 26 06:59:48.724600 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:48.724577    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee26d8b_30ca_4d60_99b6_f2eab46b9e2c.slice/crio-168d3707ab5952b8f7ccc792edee60547929557238a2e576d3628a97bf01a53e WatchSource:0}: Error finding container 168d3707ab5952b8f7ccc792edee60547929557238a2e576d3628a97bf01a53e: Status 404 returned error can't find the container with id 168d3707ab5952b8f7ccc792edee60547929557238a2e576d3628a97bf01a53e
May 26 06:59:48.819174 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.819103    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55784c4fdb-pzzhw"]
May 26 06:59:48.822073 ip-10-0-133-78 kubenswrapper[2552]: W0526 06:59:48.822047    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4669bbd7_c56c_438f_a9a2_5ed5f5244c10.slice/crio-7a30bb0ac940608456a90520bcd0727de264a6d48af968974f1b168720d2259e WatchSource:0}: Error finding container 7a30bb0ac940608456a90520bcd0727de264a6d48af968974f1b168720d2259e: Status 404 returned error can't find the container with id 7a30bb0ac940608456a90520bcd0727de264a6d48af968974f1b168720d2259e
May 26 06:59:48.931828 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.931789    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw" event={"ID":"4669bbd7-c56c-438f-a9a2-5ed5f5244c10","Type":"ContainerStarted","Data":"4e7eca8f9eb43e8baff543bc5d65f19aad5734fd764fbe44f211284044e73b11"}
May 26 06:59:48.931828 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.931832    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw" event={"ID":"4669bbd7-c56c-438f-a9a2-5ed5f5244c10","Type":"ContainerStarted","Data":"7a30bb0ac940608456a90520bcd0727de264a6d48af968974f1b168720d2259e"}
May 26 06:59:48.932041 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.931913    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 06:59:48.932885 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.932853    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fz6cw" event={"ID":"0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c","Type":"ContainerStarted","Data":"168d3707ab5952b8f7ccc792edee60547929557238a2e576d3628a97bf01a53e"}
May 26 06:59:48.934142 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.934118    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjd4h" event={"ID":"64be458e-4094-41e1-be76-6db601002aa2","Type":"ContainerStarted","Data":"e7fd855d8b89756f97ee51323299fbfe95e508c64d675f33e44b50004d2dde23"}
May 26 06:59:48.934142 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.934144    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjd4h" event={"ID":"64be458e-4094-41e1-be76-6db601002aa2","Type":"ContainerStarted","Data":"c2fc9bbbeba0d96dba6e44ccee9fe17c8cd875d526d8076886668402014d1d76"}
May 26 06:59:48.949729 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:48.949684    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw" podStartSLOduration=0.949671501 podStartE2EDuration="949.671501ms" podCreationTimestamp="2026-05-26 06:59:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:59:48.949241017 +0000 UTC m=+171.170095421" watchObservedRunningTime="2026-05-26 06:59:48.949671501 +0000 UTC m=+171.170525903"
May 26 06:59:49.938856 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:49.938809    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjd4h" event={"ID":"64be458e-4094-41e1-be76-6db601002aa2","Type":"ContainerStarted","Data":"b5dcb5d01fc970827c1dbcdb6a51bc7d2cf0e33023f89df1efcc2bf8f078b278"}
May 26 06:59:51.950253 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:51.950214    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zjd4h" event={"ID":"64be458e-4094-41e1-be76-6db601002aa2","Type":"ContainerStarted","Data":"060fcd10392c48e83b72b2d8013229f7db568f3581cb0ee1441d66ad0e0bcd10"}
May 26 06:59:51.968432 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:51.968365    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zjd4h" podStartSLOduration=1.860883566 podStartE2EDuration="3.968350539s" podCreationTimestamp="2026-05-26 06:59:48 +0000 UTC" firstStartedPulling="2026-05-26 06:59:48.76616547 +0000 UTC m=+170.987019856" lastFinishedPulling="2026-05-26 06:59:50.873632443 +0000 UTC m=+173.094486829" observedRunningTime="2026-05-26 06:59:51.967918636 +0000 UTC m=+174.188773053" watchObservedRunningTime="2026-05-26 06:59:51.968350539 +0000 UTC m=+174.189204945"
May 26 06:59:53.922293 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:53.922260    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svwdf"
May 26 06:59:58.273175 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.273137    2552 patch_prober.go:28] interesting pod/image-registry-7485b9db8d-2zgtm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 06:59:58.273737 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.273199    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 06:59:58.433602 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.433569    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 06:59:58.436651 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.436633    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.440032 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440007    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 06:59:58.440032 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440024    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 06:59:58.440204 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440108    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 06:59:58.440204 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440119    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 06:59:58.440204 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440007    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 06:59:58.440204 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.440028    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vbqmb\""
May 26 06:59:58.449905 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.449885    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 06:59:58.524060 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.523982    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.524198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.524085    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.524198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.524121    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.524198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.524156    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.524198 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.524192    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.524409 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.524219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn6r9\" (UniqueName: \"kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.624785 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624754    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.624785 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624784    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn6r9\" (UniqueName: \"kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625011 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624819    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625011 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624888    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625011 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624914    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625011 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.624955    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625677 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.625650    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625796 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.625710    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.625907 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.625886    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.627699 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.627672    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.627805 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.627779    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.633742 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.633719    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn6r9\" (UniqueName: \"kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9\") pod \"console-db7c4c9fc-25z4q\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") " pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 06:59:58.746685 ip-10-0-133-78 kubenswrapper[2552]: I0526 06:59:58.746652    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 07:00:03.285602 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.285568    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-svms7"]
May 26 07:00:03.288993 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.288972    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.291321 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.291295    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 07:00:03.291512 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.291470    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 07:00:03.291761 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.291742    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 07:00:03.291964 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.291946    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 07:00:03.292283 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.292258    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 07:00:03.292528 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.292511    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-knnzs\""
May 26 07:00:03.292627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.292587    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 07:00:03.364340 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364309    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skdnw\" (UniqueName: \"kubernetes.io/projected/33c8477a-dd56-4047-b1ab-1c332ece0811-kube-api-access-skdnw\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364390    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-wtmp\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364446    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-tls\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364484    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-textfile\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364644 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-accelerators-collector-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364644 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364582    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-root\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364644 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364619    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-metrics-client-ca\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364795 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-sys\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.364795 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.364675    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.443920 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.443890    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:03.446169 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.446131    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.453312 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.453291    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 07:00:03.460362 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.460340    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:03.465604 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465578    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-wtmp\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465619    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-tls\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465654    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-textfile\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465684    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-accelerators-collector-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465719    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-root\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465750    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-metrics-client-ca\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-wtmp\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465778    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-sys\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465806    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465831    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-root\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.465942 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.465898    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skdnw\" (UniqueName: \"kubernetes.io/projected/33c8477a-dd56-4047-b1ab-1c332ece0811-kube-api-access-skdnw\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.466243 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.466013    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-textfile\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.466243 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.466075    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c8477a-dd56-4047-b1ab-1c332ece0811-sys\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.466412 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.466372    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-metrics-client-ca\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.466523 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.466495    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-accelerators-collector-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.468271 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.468251    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-tls\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.468375 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.468284    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33c8477a-dd56-4047-b1ab-1c332ece0811-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.475136 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.475113    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skdnw\" (UniqueName: \"kubernetes.io/projected/33c8477a-dd56-4047-b1ab-1c332ece0811-kube-api-access-skdnw\") pod \"node-exporter-svms7\" (UID: \"33c8477a-dd56-4047-b1ab-1c332ece0811\") " pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.567066 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.566981    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567066 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sskxw\" (UniqueName: \"kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567066 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567049    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567327 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567094    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567327 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567125    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567327 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567223    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.567327 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.567248    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.599981 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.599949    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-svms7"
May 26 07:00:03.667723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667684    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.667867 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667728    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.667867 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667852    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.667982 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667893    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sskxw\" (UniqueName: \"kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.667982 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667940    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.667982 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667969    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.668129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.667998    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.668903 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.668477    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.668903 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.668742    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.669072 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.669007    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.669072 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.669058    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.670555 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.670531    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.670697 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.670680    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.689828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.689803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sskxw\" (UniqueName: \"kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw\") pod \"console-c8c44d795-7hdjs\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") " pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:03.757253 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:03.757225    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:04.132436 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:04.132241    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c8477a_dd56_4047_b1ab_1c332ece0811.slice/crio-70d0c49667345c38ac537d13c525e0dac0747065a005577054a541ef80d67da4 WatchSource:0}: Error finding container 70d0c49667345c38ac537d13c525e0dac0747065a005577054a541ef80d67da4: Status 404 returned error can't find the container with id 70d0c49667345c38ac537d13c525e0dac0747065a005577054a541ef80d67da4
May 26 07:00:04.266206 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.266183    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 07:00:04.269687 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:04.269658    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dfd6dc_3e5f_4ea3_8ae2_c5047556d9bb.slice/crio-ddf834f2dcefb56d6549771443634fe74342c8d1c42d6c0ff364fdddc887c136 WatchSource:0}: Error finding container ddf834f2dcefb56d6549771443634fe74342c8d1c42d6c0ff364fdddc887c136: Status 404 returned error can't find the container with id ddf834f2dcefb56d6549771443634fe74342c8d1c42d6c0ff364fdddc887c136
May 26 07:00:04.285228 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.285207    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:04.287322 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:04.287299    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b16d16_ae10_4c9b_ad0d_6518fe28875b.slice/crio-a6d62d52db01cf17634f8ad0e15cba968b24d6d55c211a831dc00e342ef51ba0 WatchSource:0}: Error finding container a6d62d52db01cf17634f8ad0e15cba968b24d6d55c211a831dc00e342ef51ba0: Status 404 returned error can't find the container with id a6d62d52db01cf17634f8ad0e15cba968b24d6d55c211a831dc00e342ef51ba0
May 26 07:00:04.389733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.389661    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:00:04.392996 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.392975    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.395427 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395357    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 07:00:04.395427 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395411    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 07:00:04.395627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395431    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 07:00:04.395627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395357    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 07:00:04.395627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395414    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 07:00:04.395627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395356    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 07:00:04.395886 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395784    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 07:00:04.395984 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395964    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 07:00:04.395984 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.395979    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxjdh\""
May 26 07:00:04.396127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.396061    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 07:00:04.409957 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.409931    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:00:04.476233 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476198    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476270    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476302    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476369    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476412    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.476452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476443    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476468    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476509    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476555    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsm2k\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476671    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.477046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.476798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578326    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578383    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578427    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578456    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578497    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578525    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578560    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578584    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578625    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578659    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578732    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsm2k\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578771    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.579027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.578807    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.589409 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:04.589269    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle podName:865ff692-96ff-4890-8836-d386055b1fd1 nodeName:}" failed. No retries permitted until 2026-05-26 07:00:05.089242405 +0000 UTC m=+187.310096810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "865ff692-96ff-4890-8836-d386055b1fd1") : configmap references non-existent config key: ca-bundle.crt
May 26 07:00:04.591590 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.590306    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.595282 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.594271    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.595282 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:04.594889    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 26 07:00:04.595282 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:04.594946    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls podName:865ff692-96ff-4890-8836-d386055b1fd1 nodeName:}" failed. No retries permitted until 2026-05-26 07:00:05.094927034 +0000 UTC m=+187.315781432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "865ff692-96ff-4890-8836-d386055b1fd1") : secret "alertmanager-main-tls" not found
May 26 07:00:04.595282 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.595014    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.596452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.595910    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.596452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.596020    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.596452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.596077    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.596452 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.596379    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.597471 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.597076    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.597471 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.597412    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.598419 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.598370    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.599064 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.599021    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsm2k\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:04.988023 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.987944    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8c44d795-7hdjs" event={"ID":"80b16d16-ae10-4c9b-ad0d-6518fe28875b","Type":"ContainerStarted","Data":"a6d62d52db01cf17634f8ad0e15cba968b24d6d55c211a831dc00e342ef51ba0"}
May 26 07:00:04.989594 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.989544    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7c4c9fc-25z4q" event={"ID":"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb","Type":"ContainerStarted","Data":"ddf834f2dcefb56d6549771443634fe74342c8d1c42d6c0ff364fdddc887c136"}
May 26 07:00:04.991104 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.991045    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svms7" event={"ID":"33c8477a-dd56-4047-b1ab-1c332ece0811","Type":"ContainerStarted","Data":"70d0c49667345c38ac537d13c525e0dac0747065a005577054a541ef80d67da4"}
May 26 07:00:04.997034 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.996960    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fz6cw" event={"ID":"0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c","Type":"ContainerStarted","Data":"db648f6abf32040480af796c568c108f960cbf2d423f4259a19e6b570c2e73a4"}
May 26 07:00:04.997034 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:04.997002    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 07:00:05.007591 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.007548    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-fz6cw"
May 26 07:00:05.013053 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.012733    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-fz6cw" podStartSLOduration=1.551027149 podStartE2EDuration="17.012718337s" podCreationTimestamp="2026-05-26 06:59:48 +0000 UTC" firstStartedPulling="2026-05-26 06:59:48.72671354 +0000 UTC m=+170.947567922" lastFinishedPulling="2026-05-26 07:00:04.188404713 +0000 UTC m=+186.409259110" observedRunningTime="2026-05-26 07:00:05.010506531 +0000 UTC m=+187.231360936" watchObservedRunningTime="2026-05-26 07:00:05.012718337 +0000 UTC m=+187.233572744"
May 26 07:00:05.186414 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.186359    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:05.186532 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.186517    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:05.187431 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.187383    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:05.193619 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.193555    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:05.305040 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.304612    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:00:05.512033 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:05.511999    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:00:06.002421 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:06.002354    2552 generic.go:358] "Generic (PLEG): container finished" podID="33c8477a-dd56-4047-b1ab-1c332ece0811" containerID="b13ad1c7421362d13fe29dd0197b7e8e1601b0f723aabe38c911dab2828cf3ef" exitCode=0
May 26 07:00:06.003929 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:06.003757    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svms7" event={"ID":"33c8477a-dd56-4047-b1ab-1c332ece0811","Type":"ContainerDied","Data":"b13ad1c7421362d13fe29dd0197b7e8e1601b0f723aabe38c911dab2828cf3ef"}
May 26 07:00:06.005492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:06.005448    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"f5cae48fcb8dcce5c967432d35bf6b5a5c707bc12f8a1fdc8212084d8b23cc4e"}
May 26 07:00:07.012514 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:07.012473    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svms7" event={"ID":"33c8477a-dd56-4047-b1ab-1c332ece0811","Type":"ContainerStarted","Data":"368007944f74e8ad5e150810f499adb677bf9d72901a6946a6f10f5e210775fb"}
May 26 07:00:07.013055 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:07.012521    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-svms7" event={"ID":"33c8477a-dd56-4047-b1ab-1c332ece0811","Type":"ContainerStarted","Data":"67c24d428df5443be2f33f23ce3c74f05f52b734a06629523ac60cb83eb30dbc"}
May 26 07:00:07.035811 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:07.034983    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-svms7" podStartSLOduration=2.994319173 podStartE2EDuration="4.034957618s" podCreationTimestamp="2026-05-26 07:00:03 +0000 UTC" firstStartedPulling="2026-05-26 07:00:04.13463243 +0000 UTC m=+186.355486814" lastFinishedPulling="2026-05-26 07:00:05.175270863 +0000 UTC m=+187.396125259" observedRunningTime="2026-05-26 07:00:07.032889152 +0000 UTC m=+189.253743552" watchObservedRunningTime="2026-05-26 07:00:07.034957618 +0000 UTC m=+189.255812028"
May 26 07:00:08.064586 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.064553    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"]
May 26 07:00:08.107842 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.107808    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"]
May 26 07:00:08.108050 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.107954    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:08.110492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.110464    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-qv46g\""
May 26 07:00:08.110970 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.110801    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 07:00:08.220432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.220271    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-l9dp5\" (UID: \"31d05e54-47cb-4c74-b822-d884a1c43ea2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:08.271826 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.271788    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 07:00:08.321583 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.321502    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-l9dp5\" (UID: \"31d05e54-47cb-4c74-b822-d884a1c43ea2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:08.321982 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:08.321957    2552 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 26 07:00:08.322152 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:08.322138    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert podName:31d05e54-47cb-4c74-b822-d884a1c43ea2 nodeName:}" failed. No retries permitted until 2026-05-26 07:00:08.822116346 +0000 UTC m=+191.042970732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-l9dp5" (UID: "31d05e54-47cb-4c74-b822-d884a1c43ea2") : secret "monitoring-plugin-cert" not found
May 26 07:00:08.540544 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.540509    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"]
May 26 07:00:08.591690 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.591618    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"]
May 26 07:00:08.591830 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.591780    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594447    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594483    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594524    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594544    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594488    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 07:00:08.594686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.594452    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vcjjf\""
May 26 07:00:08.599869 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.599845    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 07:00:08.725451 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725415    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-serving-certs-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725492    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gpx\" (UniqueName: \"kubernetes.io/projected/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-kube-api-access-k4gpx\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725552    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-federate-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725575    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-metrics-client-ca\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725641    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.725822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.725800    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826680    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826854 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826742    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826854 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826802    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-serving-certs-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826970 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826858    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826970 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826890    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gpx\" (UniqueName: \"kubernetes.io/projected/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-kube-api-access-k4gpx\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.826970 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826917    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-federate-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.827129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.826973    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-metrics-client-ca\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.827129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.827036    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-l9dp5\" (UID: \"31d05e54-47cb-4c74-b822-d884a1c43ea2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:08.827129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.827056    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.827924 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.827596    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-serving-certs-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.827924 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.827830    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.827924 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.827872    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-metrics-client-ca\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.829865 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.829842    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-federate-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.829974 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.829945    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.830163 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.830138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31d05e54-47cb-4c74-b822-d884a1c43ea2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-l9dp5\" (UID: \"31d05e54-47cb-4c74-b822-d884a1c43ea2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:08.830793 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.830772    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.830914 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.830892    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-telemeter-client-tls\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.841581 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.841537    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gpx\" (UniqueName: \"kubernetes.io/projected/f5d08d3c-b185-4f80-a0ff-637c0b4e90a8-kube-api-access-k4gpx\") pod \"telemeter-client-6cd5d98d7-r94rn\" (UID: \"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8\") " pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:08.854662 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.854639    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 07:00:08.883653 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.883620    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:08.903688 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.903654    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:08.903839 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.903793    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:08.904117 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:08.904088    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"
May 26 07:00:09.022326 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.022301    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:09.029290 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029267    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029434 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029306    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029434 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029422    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029560 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029458    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029605 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029565    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcb4\" (UniqueName: \"kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029654 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029638    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.029697 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.029678    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.130520 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.130433    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.130520 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.130500    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131020 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.130537    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131020 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.130589    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131205 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131154    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131423 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131373    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131622    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131675    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131729    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.131922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.131801    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcb4\" (UniqueName: \"kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.132417 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.132378    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.133994 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.133973    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.135282 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.135239    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.146770 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.146748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcb4\" (UniqueName: \"kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4\") pod \"console-5879466748-cshhp\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") " pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.215887 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.215847    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:09.337166 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.337116    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd5d98d7-r94rn"]
May 26 07:00:09.341016 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:09.340854    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d08d3c_b185_4f80_a0ff_637c0b4e90a8.slice/crio-ebea514df1035b400e42bdeca61de1dae6783a3f8cdfc6645e17629234d8fd9f WatchSource:0}: Error finding container ebea514df1035b400e42bdeca61de1dae6783a3f8cdfc6645e17629234d8fd9f: Status 404 returned error can't find the container with id ebea514df1035b400e42bdeca61de1dae6783a3f8cdfc6645e17629234d8fd9f
May 26 07:00:09.363955 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.362451    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"]
May 26 07:00:09.429051 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.428999    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:09.440561 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:09.440515    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43715aeb_35a6_45a1_b03b_6094fc53467a.slice/crio-635617bbf284fe7c2eaac2d6fdda36ae6f7126110fc3539dc82430fc01540f30 WatchSource:0}: Error finding container 635617bbf284fe7c2eaac2d6fdda36ae6f7126110fc3539dc82430fc01540f30: Status 404 returned error can't find the container with id 635617bbf284fe7c2eaac2d6fdda36ae6f7126110fc3539dc82430fc01540f30
May 26 07:00:09.944606 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:09.943888    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55784c4fdb-pzzhw"
May 26 07:00:10.025769 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.025731    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8c44d795-7hdjs" event={"ID":"80b16d16-ae10-4c9b-ad0d-6518fe28875b","Type":"ContainerStarted","Data":"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"}
May 26 07:00:10.028677 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.028647    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7c4c9fc-25z4q" event={"ID":"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb","Type":"ContainerStarted","Data":"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"}
May 26 07:00:10.033044 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.033009    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5" event={"ID":"31d05e54-47cb-4c74-b822-d884a1c43ea2","Type":"ContainerStarted","Data":"abbc11a9af3829e6bfdb4e345e4fed9c6c9cd5d6c0b5edeef39029b8c104ed03"}
May 26 07:00:10.035595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.035479    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21" exitCode=0
May 26 07:00:10.035595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.035565    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21"}
May 26 07:00:10.042795 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.040908    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5879466748-cshhp" event={"ID":"43715aeb-35a6-45a1-b03b-6094fc53467a","Type":"ContainerStarted","Data":"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"}
May 26 07:00:10.042795 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.040942    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5879466748-cshhp" event={"ID":"43715aeb-35a6-45a1-b03b-6094fc53467a","Type":"ContainerStarted","Data":"635617bbf284fe7c2eaac2d6fdda36ae6f7126110fc3539dc82430fc01540f30"}
May 26 07:00:10.045294 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.045244    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn" event={"ID":"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8","Type":"ContainerStarted","Data":"ebea514df1035b400e42bdeca61de1dae6783a3f8cdfc6645e17629234d8fd9f"}
May 26 07:00:10.055110 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.054476    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c8c44d795-7hdjs" podStartSLOduration=2.211038395 podStartE2EDuration="7.054459608s" podCreationTimestamp="2026-05-26 07:00:03 +0000 UTC" firstStartedPulling="2026-05-26 07:00:04.289152904 +0000 UTC m=+186.510007291" lastFinishedPulling="2026-05-26 07:00:09.132574105 +0000 UTC m=+191.353428504" observedRunningTime="2026-05-26 07:00:10.054099803 +0000 UTC m=+192.274954211" watchObservedRunningTime="2026-05-26 07:00:10.054459608 +0000 UTC m=+192.275314014"
May 26 07:00:10.081508 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.081450    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-db7c4c9fc-25z4q" podStartSLOduration=7.208408268 podStartE2EDuration="12.081431164s" podCreationTimestamp="2026-05-26 06:59:58 +0000 UTC" firstStartedPulling="2026-05-26 07:00:04.271705613 +0000 UTC m=+186.492560009" lastFinishedPulling="2026-05-26 07:00:09.144728507 +0000 UTC m=+191.365582905" observedRunningTime="2026-05-26 07:00:10.081325534 +0000 UTC m=+192.302179939" watchObservedRunningTime="2026-05-26 07:00:10.081431164 +0000 UTC m=+192.302285572"
May 26 07:00:10.149923 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:10.149876    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5879466748-cshhp" podStartSLOduration=2.149857805 podStartE2EDuration="2.149857805s" podCreationTimestamp="2026-05-26 07:00:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:00:10.148152672 +0000 UTC m=+192.369007079" watchObservedRunningTime="2026-05-26 07:00:10.149857805 +0000 UTC m=+192.370712213"
May 26 07:00:13.285588 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.285552    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" containerName="registry" containerID="cri-o://c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061" gracePeriod=30
May 26 07:00:13.559369 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.559347    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 07:00:13.679307 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679283    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679328    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679360    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkbmw\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679390    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679458    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679495    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679563    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679751 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679629    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration\") pod \"c1456a7b-20d9-4bce-9576-611713e4017a\" (UID: \"c1456a7b-20d9-4bce-9576-611713e4017a\") "
May 26 07:00:13.679902 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.679876    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:13.680234 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.680194    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:13.682164 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.682121    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:13.682264 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.682191    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw" (OuterVolumeSpecName: "kube-api-access-dkbmw") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "kube-api-access-dkbmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:13.682431 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.682374    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:13.682717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.682678    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:13.683045 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.683016    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:13.688686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.688652    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1456a7b-20d9-4bce-9576-611713e4017a" (UID: "c1456a7b-20d9-4bce-9576-611713e4017a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:00:13.758137 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.758115    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:13.758233 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.758146    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:13.762868 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.762849    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:13.780991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.780927    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1456a7b-20d9-4bce-9576-611713e4017a-ca-trust-extracted\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.780991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.780954    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-trusted-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.780991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.780970    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-image-registry-private-configuration\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.780991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.780983    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-bound-sa-token\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.781172 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.780996    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.781172 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.781009    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkbmw\" (UniqueName: \"kubernetes.io/projected/c1456a7b-20d9-4bce-9576-611713e4017a-kube-api-access-dkbmw\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.781172 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.781021    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1456a7b-20d9-4bce-9576-611713e4017a-installation-pull-secrets\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:13.781172 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:13.781035    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1456a7b-20d9-4bce-9576-611713e4017a-registry-certificates\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:14.066492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.066383    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn" event={"ID":"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8","Type":"ContainerStarted","Data":"b564c6382fd1caca45eb46783d0f7a8ad6815901e0b16c4df5617e254d2766b0"}
May 26 07:00:14.066492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.066446    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn" event={"ID":"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8","Type":"ContainerStarted","Data":"d275d503de763c00dbaa1661916354e4eb85e4b26d740da69be734b107a83bb1"}
May 26 07:00:14.066492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.066459    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn" event={"ID":"f5d08d3c-b185-4f80-a0ff-637c0b4e90a8","Type":"ContainerStarted","Data":"0c4381e43efbf9ea8db3a9aad34b440f2b8b38b998d97c50789882eab74b2ce9"}
May 26 07:00:14.067698 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.067668    2552 generic.go:358] "Generic (PLEG): container finished" podID="c1456a7b-20d9-4bce-9576-611713e4017a" containerID="c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061" exitCode=0
May 26 07:00:14.067786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.067733    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm"
May 26 07:00:14.067786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.067736    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" event={"ID":"c1456a7b-20d9-4bce-9576-611713e4017a","Type":"ContainerDied","Data":"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"}
May 26 07:00:14.067786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.067762    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7485b9db8d-2zgtm" event={"ID":"c1456a7b-20d9-4bce-9576-611713e4017a","Type":"ContainerDied","Data":"1697330369d0e954a245a87e2aab5f0e66b4a56303e5996431e7a0c689d1d3fb"}
May 26 07:00:14.067786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.067781    2552 scope.go:117] "RemoveContainer" containerID="c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"
May 26 07:00:14.069490 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.069195    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5" event={"ID":"31d05e54-47cb-4c74-b822-d884a1c43ea2","Type":"ContainerStarted","Data":"cb923e89971894cb761a2e9dbbf66d278b787696e57b46d23ea7d6ab28ab1f2b"}
May 26 07:00:14.069490 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.069357    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:14.072463 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.072438    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"}
May 26 07:00:14.072561 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.072469    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"}
May 26 07:00:14.072561 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.072503    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"}
May 26 07:00:14.072561 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.072520    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"}
May 26 07:00:14.072561 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.072533    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"}
May 26 07:00:14.075150 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.075133    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5"
May 26 07:00:14.076383 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.076364    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:14.089948 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.089910    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cd5d98d7-r94rn" podStartSLOduration=2.372697746 podStartE2EDuration="6.089899212s" podCreationTimestamp="2026-05-26 07:00:08 +0000 UTC" firstStartedPulling="2026-05-26 07:00:09.343441912 +0000 UTC m=+191.564296298" lastFinishedPulling="2026-05-26 07:00:13.060643379 +0000 UTC m=+195.281497764" observedRunningTime="2026-05-26 07:00:14.088629047 +0000 UTC m=+196.309483453" watchObservedRunningTime="2026-05-26 07:00:14.089899212 +0000 UTC m=+196.310753625"
May 26 07:00:14.090991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.090965    2552 scope.go:117] "RemoveContainer" containerID="c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"
May 26 07:00:14.091233 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:14.091214    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061\": container with ID starting with c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061 not found: ID does not exist" containerID="c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"
May 26 07:00:14.091289 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.091239    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061"} err="failed to get container status \"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061\": rpc error: code = NotFound desc = could not find container \"c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061\": container with ID starting with c3498fb86c3dff702a8e1271b43898c9d8f3ddab3985144a5b6b31672ebb4061 not found: ID does not exist"
May 26 07:00:14.119261 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.119215    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-l9dp5" podStartSLOduration=2.445912223 podStartE2EDuration="6.119204798s" podCreationTimestamp="2026-05-26 07:00:08 +0000 UTC" firstStartedPulling="2026-05-26 07:00:09.387889502 +0000 UTC m=+191.608743900" lastFinishedPulling="2026-05-26 07:00:13.061182089 +0000 UTC m=+195.282036475" observedRunningTime="2026-05-26 07:00:14.11859638 +0000 UTC m=+196.339450785" watchObservedRunningTime="2026-05-26 07:00:14.119204798 +0000 UTC m=+196.340059204"
May 26 07:00:14.139575 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.139547    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 07:00:14.143197 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.143174    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7485b9db8d-2zgtm"]
May 26 07:00:14.450345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.450312    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" path="/var/lib/kubelet/pods/c1456a7b-20d9-4bce-9576-611713e4017a/volumes"
May 26 07:00:14.806033 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.805886    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:14.842029 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.842002    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:00:14.842291 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.842279    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" containerName="registry"
May 26 07:00:14.842340 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.842293    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" containerName="registry"
May 26 07:00:14.842374 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.842355    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1456a7b-20d9-4bce-9576-611713e4017a" containerName="registry"
May 26 07:00:14.858236 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.858217    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.862441 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.862418    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:00:14.889643 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889615    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889748 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889715    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889806 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889806 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889787    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7kmd\" (UniqueName: \"kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889911 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889828    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889963 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889908    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.889963 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.889938    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990328 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990301    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990469 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990335    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990469 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990353    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7kmd\" (UniqueName: \"kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990469 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990373    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990469 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990447    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990673 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990473    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.990673 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.990506    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.991069 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.991046    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.991146 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.991095    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.991263 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.991245    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.991350 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.991330    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.992827 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.992803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:14.992933 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:14.992911    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:15.000045 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:15.000022    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7kmd\" (UniqueName: \"kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd\") pod \"console-6b8884d865-6j5c9\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") " pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:15.168284 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:15.168255    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:15.293986 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:15.293955    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:00:15.297097 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:00:15.297064    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b4177b_74db_4c26_8899_4966584ffbfe.slice/crio-e2882a002e6295320725a52b4598401b8f7a2e884dc127d0476a59ea089b767c WatchSource:0}: Error finding container e2882a002e6295320725a52b4598401b8f7a2e884dc127d0476a59ea089b767c: Status 404 returned error can't find the container with id e2882a002e6295320725a52b4598401b8f7a2e884dc127d0476a59ea089b767c
May 26 07:00:16.081625 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:16.081592    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerStarted","Data":"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"}
May 26 07:00:16.083004 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:16.082972    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8884d865-6j5c9" event={"ID":"86b4177b-74db-4c26-8899-4966584ffbfe","Type":"ContainerStarted","Data":"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"}
May 26 07:00:16.083129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:16.083008    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8884d865-6j5c9" event={"ID":"86b4177b-74db-4c26-8899-4966584ffbfe","Type":"ContainerStarted","Data":"e2882a002e6295320725a52b4598401b8f7a2e884dc127d0476a59ea089b767c"}
May 26 07:00:16.109275 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:16.109232    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.654250978 podStartE2EDuration="12.109221008s" podCreationTimestamp="2026-05-26 07:00:04 +0000 UTC" firstStartedPulling="2026-05-26 07:00:05.518933991 +0000 UTC m=+187.739788394" lastFinishedPulling="2026-05-26 07:00:14.973904038 +0000 UTC m=+197.194758424" observedRunningTime="2026-05-26 07:00:16.107561122 +0000 UTC m=+198.328415540" watchObservedRunningTime="2026-05-26 07:00:16.109221008 +0000 UTC m=+198.330075442"
May 26 07:00:16.132976 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:16.132923    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b8884d865-6j5c9" podStartSLOduration=2.132908659 podStartE2EDuration="2.132908659s" podCreationTimestamp="2026-05-26 07:00:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:00:16.130751861 +0000 UTC m=+198.351606268" watchObservedRunningTime="2026-05-26 07:00:16.132908659 +0000 UTC m=+198.353763065"
May 26 07:00:18.747145 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:18.747099    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 07:00:19.217269 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:19.217240    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:25.169316 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:25.169281    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:25.169316 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:25.169320    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:25.173970 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:25.173949    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:26.114738 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:26.114712    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:00:26.158864 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:26.158837    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:35.058013 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.057946    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-db7c4c9fc-25z4q" podUID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" containerName="console" containerID="cri-o://6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6" gracePeriod=15
May 26 07:00:35.311850 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.311792    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-db7c4c9fc-25z4q_78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb/console/0.log"
May 26 07:00:35.311957 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.311854    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 07:00:35.361945 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.361907    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362120 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.361953    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362120 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362023    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362120 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362086    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362120 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362117    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn6r9\" (UniqueName: \"kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362314 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362147    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config\") pod \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\" (UID: \"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb\") "
May 26 07:00:35.362448 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362415    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:35.362533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362420    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:35.362533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.362487    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config" (OuterVolumeSpecName: "console-config") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:35.364317 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.364286    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9" (OuterVolumeSpecName: "kube-api-access-jn6r9") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "kube-api-access-jn6r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:35.364472 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.364327    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:35.364472 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.364369    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" (UID: "78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:35.463174 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463128    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn6r9\" (UniqueName: \"kubernetes.io/projected/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-kube-api-access-jn6r9\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:35.463174 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463168    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-oauth-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:35.463174 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463180    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-oauth-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:35.463439 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463194    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-service-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:35.463439 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463207    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:35.463439 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:35.463218    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb-console-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:36.140171 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140141    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-db7c4c9fc-25z4q_78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb/console/0.log"
May 26 07:00:36.140627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140184    2552 generic.go:358] "Generic (PLEG): container finished" podID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" containerID="6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6" exitCode=2
May 26 07:00:36.140627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140217    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7c4c9fc-25z4q" event={"ID":"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb","Type":"ContainerDied","Data":"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"}
May 26 07:00:36.140627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140257    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7c4c9fc-25z4q" event={"ID":"78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb","Type":"ContainerDied","Data":"ddf834f2dcefb56d6549771443634fe74342c8d1c42d6c0ff364fdddc887c136"}
May 26 07:00:36.140627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140270    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7c4c9fc-25z4q"
May 26 07:00:36.140627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.140275    2552 scope.go:117] "RemoveContainer" containerID="6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"
May 26 07:00:36.148477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.148456    2552 scope.go:117] "RemoveContainer" containerID="6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"
May 26 07:00:36.148738 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:36.148719    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6\": container with ID starting with 6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6 not found: ID does not exist" containerID="6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"
May 26 07:00:36.148802 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.148749    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6"} err="failed to get container status \"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6\": rpc error: code = NotFound desc = could not find container \"6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6\": container with ID starting with 6d1e104e421e5764c8229cb055c84f2b77cafb1d6a05be3c30f5565dddfb2cb6 not found: ID does not exist"
May 26 07:00:36.161083 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.161057    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 07:00:36.164600 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.164568    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db7c4c9fc-25z4q"]
May 26 07:00:36.449907 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:36.449830    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" path="/var/lib/kubelet/pods/78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb/volumes"
May 26 07:00:39.825595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:39.825541    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5879466748-cshhp" podUID="43715aeb-35a6-45a1-b03b-6094fc53467a" containerName="console" containerID="cri-o://dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5" gracePeriod=15
May 26 07:00:40.081704 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.081642    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5879466748-cshhp_43715aeb-35a6-45a1-b03b-6094fc53467a/console/0.log"
May 26 07:00:40.081832 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.081723    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:40.153141 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153112    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5879466748-cshhp_43715aeb-35a6-45a1-b03b-6094fc53467a/console/0.log"
May 26 07:00:40.153305 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153151    2552 generic.go:358] "Generic (PLEG): container finished" podID="43715aeb-35a6-45a1-b03b-6094fc53467a" containerID="dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5" exitCode=2
May 26 07:00:40.153305 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153204    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5879466748-cshhp" event={"ID":"43715aeb-35a6-45a1-b03b-6094fc53467a","Type":"ContainerDied","Data":"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"}
May 26 07:00:40.153305 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153220    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5879466748-cshhp"
May 26 07:00:40.153305 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153235    2552 scope.go:117] "RemoveContainer" containerID="dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"
May 26 07:00:40.153305 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.153225    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5879466748-cshhp" event={"ID":"43715aeb-35a6-45a1-b03b-6094fc53467a","Type":"ContainerDied","Data":"635617bbf284fe7c2eaac2d6fdda36ae6f7126110fc3539dc82430fc01540f30"}
May 26 07:00:40.160850 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.160823    2552 scope.go:117] "RemoveContainer" containerID="dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"
May 26 07:00:40.161093 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:40.161075    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5\": container with ID starting with dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5 not found: ID does not exist" containerID="dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"
May 26 07:00:40.161132 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.161102    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5"} err="failed to get container status \"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5\": rpc error: code = NotFound desc = could not find container \"dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5\": container with ID starting with dc7e1d7cfaa3b31458fba16df0529a1259446f0f3ded6096cb781ab9fa06a5e5 not found: ID does not exist"
May 26 07:00:40.204568 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204533    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204577    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204600    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204628    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204653    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204696    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvcb4\" (UniqueName: \"kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.204733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.204726    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca\") pod \"43715aeb-35a6-45a1-b03b-6094fc53467a\" (UID: \"43715aeb-35a6-45a1-b03b-6094fc53467a\") "
May 26 07:00:40.205061 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.205030    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config" (OuterVolumeSpecName: "console-config") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:40.205232 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.205200    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:40.205409 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.205267    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca" (OuterVolumeSpecName: "service-ca") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:40.205539 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.205423    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:40.206775 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.206751    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:40.206965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.206799    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:40.206965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.206800    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4" (OuterVolumeSpecName: "kube-api-access-dvcb4") pod "43715aeb-35a6-45a1-b03b-6094fc53467a" (UID: "43715aeb-35a6-45a1-b03b-6094fc53467a"). InnerVolumeSpecName "kube-api-access-dvcb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:40.306164 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306127    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-oauth-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306164 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306159    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-console-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306164 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306170    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-oauth-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306420 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306179    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-trusted-ca-bundle\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306420 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306188    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43715aeb-35a6-45a1-b03b-6094fc53467a-console-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306420 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306197    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvcb4\" (UniqueName: \"kubernetes.io/projected/43715aeb-35a6-45a1-b03b-6094fc53467a-kube-api-access-dvcb4\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.306420 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.306206    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43715aeb-35a6-45a1-b03b-6094fc53467a-service-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:40.470318 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.470286    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:40.476263 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:40.476237    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5879466748-cshhp"]
May 26 07:00:42.449978 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:42.449942    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43715aeb-35a6-45a1-b03b-6094fc53467a" path="/var/lib/kubelet/pods/43715aeb-35a6-45a1-b03b-6094fc53467a/volumes"
May 26 07:00:49.179553 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:49.179516    2552 generic.go:358] "Generic (PLEG): container finished" podID="ca413db1-14bb-450c-83d2-3dd72ce54e80" containerID="e15fc54f1ba68421b0d4c30aa21fd41d165560f1ffb8d457d1040c9543d668aa" exitCode=0
May 26 07:00:49.179978 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:49.179588    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5" event={"ID":"ca413db1-14bb-450c-83d2-3dd72ce54e80","Type":"ContainerDied","Data":"e15fc54f1ba68421b0d4c30aa21fd41d165560f1ffb8d457d1040c9543d668aa"}
May 26 07:00:49.179978 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:49.179891    2552 scope.go:117] "RemoveContainer" containerID="e15fc54f1ba68421b0d4c30aa21fd41d165560f1ffb8d457d1040c9543d668aa"
May 26 07:00:50.184380 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:50.184344    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-664k5" event={"ID":"ca413db1-14bb-450c-83d2-3dd72ce54e80","Type":"ContainerStarted","Data":"2d51fc1ba5f24d0981e2fc6f13506cc1d557cddce188d21d20722c3916965216"}
May 26 07:00:51.178577 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.178517    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c8c44d795-7hdjs" podUID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" containerName="console" containerID="cri-o://5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8" gracePeriod=15
May 26 07:00:51.450571 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.450545    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c8c44d795-7hdjs_80b16d16-ae10-4c9b-ad0d-6518fe28875b/console/0.log"
May 26 07:00:51.450864 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.450605    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:51.606330 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606294    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606330 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606339    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606565 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606382    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606565 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606499    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sskxw\" (UniqueName: \"kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606565 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606546    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606722 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606569    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606722 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606606    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert\") pod \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\" (UID: \"80b16d16-ae10-4c9b-ad0d-6518fe28875b\") "
May 26 07:00:51.606822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606808    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca" (OuterVolumeSpecName: "service-ca") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:51.606916 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606886    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:51.606978 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606924    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:51.607038 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606978    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-service-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.607038 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606992    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-oauth-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.607038 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.606998    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config" (OuterVolumeSpecName: "console-config") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:00:51.608602 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.608571    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:51.608602 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.608582    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw" (OuterVolumeSpecName: "kube-api-access-sskxw") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "kube-api-access-sskxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:00:51.608602 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.608593    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80b16d16-ae10-4c9b-ad0d-6518fe28875b" (UID: "80b16d16-ae10-4c9b-ad0d-6518fe28875b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:00:51.707878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.707793    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-oauth-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.707878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.707825    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sskxw\" (UniqueName: \"kubernetes.io/projected/80b16d16-ae10-4c9b-ad0d-6518fe28875b-kube-api-access-sskxw\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.707878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.707836    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-trusted-ca-bundle\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.707878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.707844    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:51.707878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:51.707854    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80b16d16-ae10-4c9b-ad0d-6518fe28875b-console-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:00:52.191249 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191220    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c8c44d795-7hdjs_80b16d16-ae10-4c9b-ad0d-6518fe28875b/console/0.log"
May 26 07:00:52.191436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191260    2552 generic.go:358] "Generic (PLEG): container finished" podID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" containerID="5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8" exitCode=2
May 26 07:00:52.191436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191329    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c8c44d795-7hdjs"
May 26 07:00:52.191436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191356    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8c44d795-7hdjs" event={"ID":"80b16d16-ae10-4c9b-ad0d-6518fe28875b","Type":"ContainerDied","Data":"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"}
May 26 07:00:52.191436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191388    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c8c44d795-7hdjs" event={"ID":"80b16d16-ae10-4c9b-ad0d-6518fe28875b","Type":"ContainerDied","Data":"a6d62d52db01cf17634f8ad0e15cba968b24d6d55c211a831dc00e342ef51ba0"}
May 26 07:00:52.191436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.191425    2552 scope.go:117] "RemoveContainer" containerID="5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"
May 26 07:00:52.199934 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.199913    2552 scope.go:117] "RemoveContainer" containerID="5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"
May 26 07:00:52.200188 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:00:52.200172    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8\": container with ID starting with 5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8 not found: ID does not exist" containerID="5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"
May 26 07:00:52.200261 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.200205    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8"} err="failed to get container status \"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8\": rpc error: code = NotFound desc = could not find container \"5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8\": container with ID starting with 5411fecd88852583c8983e7f910509c7882d7cc3252e8cbadb3f50b7f8a93aa8 not found: ID does not exist"
May 26 07:00:52.212766 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.212743    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:52.216973 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.216951    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c8c44d795-7hdjs"]
May 26 07:00:52.449119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:00:52.449046    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" path="/var/lib/kubelet/pods/80b16d16-ae10-4c9b-ad0d-6518fe28875b/volumes"
May 26 07:01:10.157600 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:10.157491    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 07:01:10.159890 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:10.159863    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3534cd-da84-4818-ab24-378f8ebef1fe-metrics-certs\") pod \"network-metrics-daemon-wthnw\" (UID: \"2c3534cd-da84-4818-ab24-378f8ebef1fe\") " pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 07:01:10.250089 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:10.250059    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph2b6\""
May 26 07:01:10.258060 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:10.258031    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthnw"
May 26 07:01:10.379893 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:10.379854    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wthnw"]
May 26 07:01:10.382666 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:01:10.382634    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3534cd_da84_4818_ab24_378f8ebef1fe.slice/crio-4a49e2e8f230ecd6b9342eca797741e870deda095e6a9dfe136118213eb74445 WatchSource:0}: Error finding container 4a49e2e8f230ecd6b9342eca797741e870deda095e6a9dfe136118213eb74445: Status 404 returned error can't find the container with id 4a49e2e8f230ecd6b9342eca797741e870deda095e6a9dfe136118213eb74445
May 26 07:01:11.244837 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:11.244796    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthnw" event={"ID":"2c3534cd-da84-4818-ab24-378f8ebef1fe","Type":"ContainerStarted","Data":"4a49e2e8f230ecd6b9342eca797741e870deda095e6a9dfe136118213eb74445"}
May 26 07:01:12.249537 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:12.249502    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthnw" event={"ID":"2c3534cd-da84-4818-ab24-378f8ebef1fe","Type":"ContainerStarted","Data":"333c5fba3deb912a3ed6c1dd6af46c9035bac3d280432fe1e5e6acb722f3a166"}
May 26 07:01:12.249537 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:12.249541    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthnw" event={"ID":"2c3534cd-da84-4818-ab24-378f8ebef1fe","Type":"ContainerStarted","Data":"9f78c644d7abf9a8619c01b42d028d101d745b497cd928e616f33bf2e885101e"}
May 26 07:01:12.266173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:12.266128    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wthnw" podStartSLOduration=253.309330549 podStartE2EDuration="4m14.266115662s" podCreationTimestamp="2026-05-26 06:56:58 +0000 UTC" firstStartedPulling="2026-05-26 07:01:10.384472319 +0000 UTC m=+252.605326702" lastFinishedPulling="2026-05-26 07:01:11.341257432 +0000 UTC m=+253.562111815" observedRunningTime="2026-05-26 07:01:12.265790059 +0000 UTC m=+254.486644463" watchObservedRunningTime="2026-05-26 07:01:12.266115662 +0000 UTC m=+254.486970067"
May 26 07:01:20.089147 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089115    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089437    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089450    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089458    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089463    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089469    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43715aeb-35a6-45a1-b03b-6094fc53467a" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089474    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="43715aeb-35a6-45a1-b03b-6094fc53467a" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089516    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="80b16d16-ae10-4c9b-ad0d-6518fe28875b" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089523    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="43715aeb-35a6-45a1-b03b-6094fc53467a" containerName="console"
May 26 07:01:20.089533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.089530    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="78dfd6dc-3e5f-4ea3-8ae2-c5047556d9bb" containerName="console"
May 26 07:01:20.091909 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.091884    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.104503 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.104477    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:01:20.135353 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135315    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135546 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135376    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135546 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135447    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135546 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135526    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135699 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135562    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135699 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135648    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plx96\" (UniqueName: \"kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.135699 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.135688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236682 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236644    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plx96\" (UniqueName: \"kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236682 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236685    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236898 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236706    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236898 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236737    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236898 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236763    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236898 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236785    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.236898 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.236812    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.237575 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.237546    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.237702 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.237550    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.237702 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.237586    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.237702 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.237643    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.239239 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.239216    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.239313 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.239274    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.245201 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.245180    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plx96\" (UniqueName: \"kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96\") pod \"console-c68bbd755-bdrgc\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") " pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.400993 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.400947    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:20.541449 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:20.541412    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:01:20.544744 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:01:20.544716    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7612e2c_20f1_4d07_8006_059913f23184.slice/crio-23d4958a7d98b78d060458cc68721baa6ef420fd0977374412c03107e9199c29 WatchSource:0}: Error finding container 23d4958a7d98b78d060458cc68721baa6ef420fd0977374412c03107e9199c29: Status 404 returned error can't find the container with id 23d4958a7d98b78d060458cc68721baa6ef420fd0977374412c03107e9199c29
May 26 07:01:21.274951 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:21.274915    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c68bbd755-bdrgc" event={"ID":"d7612e2c-20f1-4d07-8006-059913f23184","Type":"ContainerStarted","Data":"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"}
May 26 07:01:21.274951 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:21.274957    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c68bbd755-bdrgc" event={"ID":"d7612e2c-20f1-4d07-8006-059913f23184","Type":"ContainerStarted","Data":"23d4958a7d98b78d060458cc68721baa6ef420fd0977374412c03107e9199c29"}
May 26 07:01:21.293005 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:21.292956    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c68bbd755-bdrgc" podStartSLOduration=1.2929416599999999 podStartE2EDuration="1.29294166s" podCreationTimestamp="2026-05-26 07:01:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:01:21.292186916 +0000 UTC m=+263.513041324" watchObservedRunningTime="2026-05-26 07:01:21.29294166 +0000 UTC m=+263.513796071"
May 26 07:01:23.657067 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657030    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:23.657568 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657497    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="alertmanager" containerID="cri-o://7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e" gracePeriod=120
May 26 07:01:23.657659 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657537    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy" containerID="cri-o://531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e" gracePeriod=120
May 26 07:01:23.657659 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657564    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="prom-label-proxy" containerID="cri-o://e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746" gracePeriod=120
May 26 07:01:23.657659 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657589    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-metric" containerID="cri-o://f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538" gracePeriod=120
May 26 07:01:23.657659 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657552    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="config-reloader" containerID="cri-o://a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1" gracePeriod=120
May 26 07:01:23.657849 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:23.657537    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-web" containerID="cri-o://d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783" gracePeriod=120
May 26 07:01:24.286531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286499    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746" exitCode=0
May 26 07:01:24.286531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286525    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538" exitCode=0
May 26 07:01:24.286531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286532    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e" exitCode=0
May 26 07:01:24.286531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286538    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1" exitCode=0
May 26 07:01:24.286531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286543    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e" exitCode=0
May 26 07:01:24.286805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286568    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"}
May 26 07:01:24.286805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286599    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"}
May 26 07:01:24.286805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286608    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"}
May 26 07:01:24.286805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286617    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"}
May 26 07:01:24.286805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.286626    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"}
May 26 07:01:24.907819 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.907788    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:24.976671 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976635    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.976828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976695    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.976828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976725    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.976828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976754    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.976828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976782    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.976828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976809    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976836    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976886    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976912    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976952    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.976982    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.977021    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.977059    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsm2k\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k\") pod \"865ff692-96ff-4890-8836-d386055b1fd1\" (UID: \"865ff692-96ff-4890-8836-d386055b1fd1\") "
May 26 07:01:24.977993 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.977935    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:24.978855 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.978462    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:01:24.978855 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.978801    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:24.979923 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.979890    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.980031 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.979980    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume" (OuterVolumeSpecName: "config-volume") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.980841 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.980806    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k" (OuterVolumeSpecName: "kube-api-access-wsm2k") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "kube-api-access-wsm2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:01:24.981447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.981385    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out" (OuterVolumeSpecName: "config-out") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:01:24.981447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.981419    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:01:24.981447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.981384    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.982122 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.982095    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.982442 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.982380    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.984881 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.984858    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:24.992125 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:24.992097    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config" (OuterVolumeSpecName: "web-config") pod "865ff692-96ff-4890-8836-d386055b1fd1" (UID: "865ff692-96ff-4890-8836-d386055b1fd1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078500    2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-cluster-tls-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078531    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-config-out\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078541    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078549    2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-config-volume\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078558    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-metrics-client-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078567    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-main-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078576    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078587    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-main-db\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.078592 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078595    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-web-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.079006 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078604    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-tls-assets\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.079006 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078612    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/865ff692-96ff-4890-8836-d386055b1fd1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.079006 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078620    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsm2k\" (UniqueName: \"kubernetes.io/projected/865ff692-96ff-4890-8836-d386055b1fd1-kube-api-access-wsm2k\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.079006 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.078629    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/865ff692-96ff-4890-8836-d386055b1fd1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:25.292302 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.292268    2552 generic.go:358] "Generic (PLEG): container finished" podID="865ff692-96ff-4890-8836-d386055b1fd1" containerID="d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783" exitCode=0
May 26 07:01:25.292664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.292310    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"}
May 26 07:01:25.292664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.292332    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"865ff692-96ff-4890-8836-d386055b1fd1","Type":"ContainerDied","Data":"f5cae48fcb8dcce5c967432d35bf6b5a5c707bc12f8a1fdc8212084d8b23cc4e"}
May 26 07:01:25.292664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.292348    2552 scope.go:117] "RemoveContainer" containerID="e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"
May 26 07:01:25.292664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.292377    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.299446 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.299425    2552 scope.go:117] "RemoveContainer" containerID="f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"
May 26 07:01:25.306461 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.306444    2552 scope.go:117] "RemoveContainer" containerID="531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"
May 26 07:01:25.312789 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.312769    2552 scope.go:117] "RemoveContainer" containerID="d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"
May 26 07:01:25.316039 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.316018    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:25.319288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.319269    2552 scope.go:117] "RemoveContainer" containerID="a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"
May 26 07:01:25.326329 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.326310    2552 scope.go:117] "RemoveContainer" containerID="7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"
May 26 07:01:25.327688 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.327668    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:25.332941 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.332924    2552 scope.go:117] "RemoveContainer" containerID="cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21"
May 26 07:01:25.341314 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.341288    2552 scope.go:117] "RemoveContainer" containerID="e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"
May 26 07:01:25.341828 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.341806    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746\": container with ID starting with e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746 not found: ID does not exist" containerID="e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"
May 26 07:01:25.341920 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.341837    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746"} err="failed to get container status \"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746\": rpc error: code = NotFound desc = could not find container \"e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746\": container with ID starting with e6f6a293d83f0b5e73d06123b48aa68387d07d44c744b9badb410ed285a0a746 not found: ID does not exist"
May 26 07:01:25.341920 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.341859    2552 scope.go:117] "RemoveContainer" containerID="f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"
May 26 07:01:25.342113 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.342094    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538\": container with ID starting with f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538 not found: ID does not exist" containerID="f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"
May 26 07:01:25.342162 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342122    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538"} err="failed to get container status \"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538\": rpc error: code = NotFound desc = could not find container \"f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538\": container with ID starting with f845dbdbc71e74f4dc63611484b3c68e36d7ae66e45b2c19e04b726e4277a538 not found: ID does not exist"
May 26 07:01:25.342162 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342138    2552 scope.go:117] "RemoveContainer" containerID="531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"
May 26 07:01:25.342404 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.342374    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e\": container with ID starting with 531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e not found: ID does not exist" containerID="531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"
May 26 07:01:25.342457 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342410    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e"} err="failed to get container status \"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e\": rpc error: code = NotFound desc = could not find container \"531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e\": container with ID starting with 531ca0f065644ac3a42324a9eb09e117f7066f7135fd95ffc6d5bc0710321a6e not found: ID does not exist"
May 26 07:01:25.342457 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342425    2552 scope.go:117] "RemoveContainer" containerID="d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"
May 26 07:01:25.342646 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.342628    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783\": container with ID starting with d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783 not found: ID does not exist" containerID="d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"
May 26 07:01:25.342702 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342654    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783"} err="failed to get container status \"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783\": rpc error: code = NotFound desc = could not find container \"d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783\": container with ID starting with d1309a727542a5527e7d3638964e9670200513b3f68d0763d3d9dcd5c5935783 not found: ID does not exist"
May 26 07:01:25.342702 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342675    2552 scope.go:117] "RemoveContainer" containerID="a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"
May 26 07:01:25.342908 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.342892    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1\": container with ID starting with a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1 not found: ID does not exist" containerID="a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"
May 26 07:01:25.342946 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342914    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1"} err="failed to get container status \"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1\": rpc error: code = NotFound desc = could not find container \"a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1\": container with ID starting with a8766960c48c8177b084f0cb4202cb67e106b13cce478514cb94f859fbc522e1 not found: ID does not exist"
May 26 07:01:25.342946 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.342930    2552 scope.go:117] "RemoveContainer" containerID="7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"
May 26 07:01:25.343135 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.343118    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e\": container with ID starting with 7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e not found: ID does not exist" containerID="7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"
May 26 07:01:25.343171 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.343142    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e"} err="failed to get container status \"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e\": rpc error: code = NotFound desc = could not find container \"7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e\": container with ID starting with 7416311fa7a46e444c8d113ee79a755209a96433cd4ae58e06ee2adbf5130c4e not found: ID does not exist"
May 26 07:01:25.343171 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.343156    2552 scope.go:117] "RemoveContainer" containerID="cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21"
May 26 07:01:25.343353 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:25.343337    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21\": container with ID starting with cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21 not found: ID does not exist" containerID="cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21"
May 26 07:01:25.343424 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.343359    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21"} err="failed to get container status \"cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21\": rpc error: code = NotFound desc = could not find container \"cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21\": container with ID starting with cdc469fd5874fa925c61c4c2a252ce9e2c6360f561c3f93b8f97ccc36253af21 not found: ID does not exist"
May 26 07:01:25.359959 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.359929    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:25.360198 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360187    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="prom-label-proxy"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360200    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="prom-label-proxy"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360208    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="alertmanager"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360213    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="alertmanager"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360220    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="init-config-reloader"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360226    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="init-config-reloader"
May 26 07:01:25.360235 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360236    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-metric"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360241    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-metric"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360252    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-web"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360257    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-web"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360265    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="config-reloader"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360270    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="config-reloader"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360276    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360281    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360325    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="config-reloader"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360334    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="alertmanager"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360341    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-metric"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360347    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="prom-label-proxy"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360355    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy-web"
May 26 07:01:25.360432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.360360    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="865ff692-96ff-4890-8836-d386055b1fd1" containerName="kube-rbac-proxy"
May 26 07:01:25.363444 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.363426    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.366206 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366183    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 07:01:25.366375 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366183    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 07:01:25.366486 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366472    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxjdh\""
May 26 07:01:25.366678 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366661    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 07:01:25.366723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366669    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 07:01:25.366781 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366758    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 07:01:25.366893 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366757    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 07:01:25.367011 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.366996    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 07:01:25.367693 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.367676    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 07:01:25.373019 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.373000    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 07:01:25.381159 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.381133    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:25.481511 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481478    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481511 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-config-volume\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481537    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481555    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481628    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-config-out\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481658    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lglmk\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-kube-api-access-lglmk\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.481756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481744    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.482030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.482030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481836    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.482030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481866    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.482030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481917    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.482030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.481946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-web-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583035    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583077    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-web-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583149    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583181    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-config-volume\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583201    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583220    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583236    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-config-out\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583253    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583272    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lglmk\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-kube-api-access-lglmk\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583288    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583332 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583328    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583788 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583377    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.583788 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.583427    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.584327 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.584301    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586050 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586023    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586157 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586069    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586218 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586200    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-web-config\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586321 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586233    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586321 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586312    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-config-volume\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586476    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586555 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586506    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586555 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586541    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586691 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586672    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3849bccf-7a30-4347-a74b-861163eee976-config-out\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.586755 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.586739    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3849bccf-7a30-4347-a74b-861163eee976-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.588148 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.588131    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3849bccf-7a30-4347-a74b-861163eee976-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.593423 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.593389    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lglmk\" (UniqueName: \"kubernetes.io/projected/3849bccf-7a30-4347-a74b-861163eee976-kube-api-access-lglmk\") pod \"alertmanager-main-0\" (UID: \"3849bccf-7a30-4347-a74b-861163eee976\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.673173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.673116    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 07:01:25.819862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:25.819682    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 07:01:25.822896 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:01:25.822858    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3849bccf_7a30_4347_a74b_861163eee976.slice/crio-036796ce30279a2001cae4b547728f24a21d49c97169f4ebd6052354b00f93b7 WatchSource:0}: Error finding container 036796ce30279a2001cae4b547728f24a21d49c97169f4ebd6052354b00f93b7: Status 404 returned error can't find the container with id 036796ce30279a2001cae4b547728f24a21d49c97169f4ebd6052354b00f93b7
May 26 07:01:26.302008 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:26.301976    2552 generic.go:358] "Generic (PLEG): container finished" podID="3849bccf-7a30-4347-a74b-861163eee976" containerID="547e922566769b53682e956850f9bbd78c8fd7a9b5783542e88b5fdce0f45360" exitCode=0
May 26 07:01:26.302387 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:26.302017    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerDied","Data":"547e922566769b53682e956850f9bbd78c8fd7a9b5783542e88b5fdce0f45360"}
May 26 07:01:26.302387 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:26.302037    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"036796ce30279a2001cae4b547728f24a21d49c97169f4ebd6052354b00f93b7"}
May 26 07:01:26.450812 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:26.450663    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865ff692-96ff-4890-8836-d386055b1fd1" path="/var/lib/kubelet/pods/865ff692-96ff-4890-8836-d386055b1fd1/volumes"
May 26 07:01:27.308274 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308238    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"b0a2935a3ff1914a12e56d3773e91cf22b6c1509f4ef989471f7d9139c8612ef"}
May 26 07:01:27.308723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308281    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"e6ee2b158594bd026ab7f1c2a6917f301ecbafa72dcfb039db54e8cd64d6ca94"}
May 26 07:01:27.308723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308296    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"45b29da42774fafda15605161c03032f8d40db2375b88a2176c24e820e44cc3c"}
May 26 07:01:27.308723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308306    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"840905aba4a445dba178afef7fb4ea3849e37a15ec5922f83965f31c00ff792e"}
May 26 07:01:27.308723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308318    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"37fb011d03d3baa836cb5202036267c3a92add7b0727e3226aa55a86d4510437"}
May 26 07:01:27.308723 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.308331    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3849bccf-7a30-4347-a74b-861163eee976","Type":"ContainerStarted","Data":"bee5b3106cd0909ae8d0f8bc84d935d25c7c181ebcedac3311ed47d4670fe470"}
May 26 07:01:27.335813 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:27.335765    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3357491980000002 podStartE2EDuration="2.335749198s" podCreationTimestamp="2026-05-26 07:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:01:27.33410721 +0000 UTC m=+269.554961615" watchObservedRunningTime="2026-05-26 07:01:27.335749198 +0000 UTC m=+269.556603602"
May 26 07:01:30.401821 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:30.401780    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:30.401821 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:30.401822    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:30.406476 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:30.406455    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:31.324405 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:31.324360    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:01:31.372656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:31.372628    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:01:56.391583 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.391542    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b8884d865-6j5c9" podUID="86b4177b-74db-4c26-8899-4966584ffbfe" containerName="console" containerID="cri-o://3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce" gracePeriod=15
May 26 07:01:56.625252 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.625228    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b8884d865-6j5c9_86b4177b-74db-4c26-8899-4966584ffbfe/console/0.log"
May 26 07:01:56.625382 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.625287    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:01:56.746870 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.746785    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.746870 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.746820    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.746870 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.746839    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.746870 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.746872    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.747204 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.746993    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7kmd\" (UniqueName: \"kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.747204 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747043    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.747204 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747124    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert\") pod \"86b4177b-74db-4c26-8899-4966584ffbfe\" (UID: \"86b4177b-74db-4c26-8899-4966584ffbfe\") "
May 26 07:01:56.747345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747244    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config" (OuterVolumeSpecName: "console-config") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:56.747345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747257    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca" (OuterVolumeSpecName: "service-ca") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:56.747345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747277    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:56.747345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747300    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:01:56.747530 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747434    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-oauth-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.747530 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747453    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-trusted-ca-bundle\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.747530 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747473    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-service-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.747530 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.747488    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86b4177b-74db-4c26-8899-4966584ffbfe-console-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.749041 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.749017    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd" (OuterVolumeSpecName: "kube-api-access-t7kmd") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "kube-api-access-t7kmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:01:56.749163 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.749144    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:56.749245 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.749227    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86b4177b-74db-4c26-8899-4966584ffbfe" (UID: "86b4177b-74db-4c26-8899-4966584ffbfe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:01:56.848489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.848460    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.848489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.848484    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7kmd\" (UniqueName: \"kubernetes.io/projected/86b4177b-74db-4c26-8899-4966584ffbfe-kube-api-access-t7kmd\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:56.848489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:56.848494    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86b4177b-74db-4c26-8899-4966584ffbfe-console-oauth-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:01:57.397119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397092    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b8884d865-6j5c9_86b4177b-74db-4c26-8899-4966584ffbfe/console/0.log"
May 26 07:01:57.397559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397132    2552 generic.go:358] "Generic (PLEG): container finished" podID="86b4177b-74db-4c26-8899-4966584ffbfe" containerID="3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce" exitCode=2
May 26 07:01:57.397559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397232    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8884d865-6j5c9"
May 26 07:01:57.397559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397241    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8884d865-6j5c9" event={"ID":"86b4177b-74db-4c26-8899-4966584ffbfe","Type":"ContainerDied","Data":"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"}
May 26 07:01:57.397559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397293    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8884d865-6j5c9" event={"ID":"86b4177b-74db-4c26-8899-4966584ffbfe","Type":"ContainerDied","Data":"e2882a002e6295320725a52b4598401b8f7a2e884dc127d0476a59ea089b767c"}
May 26 07:01:57.397559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.397315    2552 scope.go:117] "RemoveContainer" containerID="3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"
May 26 07:01:57.405089 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.405065    2552 scope.go:117] "RemoveContainer" containerID="3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"
May 26 07:01:57.405366 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:01:57.405346    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce\": container with ID starting with 3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce not found: ID does not exist" containerID="3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"
May 26 07:01:57.405447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.405373    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce"} err="failed to get container status \"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce\": rpc error: code = NotFound desc = could not find container \"3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce\": container with ID starting with 3f9fdad623d9df9f216d4bc46e6ed527e979d84527a29bd11c7cea6f185c41ce not found: ID does not exist"
May 26 07:01:57.429954 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.429934    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:01:57.435531 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:57.435514    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8884d865-6j5c9"]
May 26 07:01:58.323711 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.323682    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:01:58.323881 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.323751    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:01:58.328507 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.328485    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:01:58.328635 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.328559    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:01:58.333515 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.333496    2552 kubelet.go:1628] "Image garbage collection succeeded"
May 26 07:01:58.449312 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:01:58.449176    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b4177b-74db-4c26-8899-4966584ffbfe" path="/var/lib/kubelet/pods/86b4177b-74db-4c26-8899-4966584ffbfe/volumes"
May 26 07:03:31.394662 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.394625    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:03:31.395128 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.394913    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b4177b-74db-4c26-8899-4966584ffbfe" containerName="console"
May 26 07:03:31.395128 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.394923    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b4177b-74db-4c26-8899-4966584ffbfe" containerName="console"
May 26 07:03:31.395128 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.394980    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b4177b-74db-4c26-8899-4966584ffbfe" containerName="console"
May 26 07:03:31.396844 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.396827    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:31.399216 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.399190    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 07:03:31.400075 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.400060    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 07:03:31.400142 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.400101    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-cl67m\""
May 26 07:03:31.405541 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.405492    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:03:31.511335 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.511271    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ttgl\" (UniqueName: \"kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl\") pod \"feast-operator-controller-manager-7b846fcd56-bqrkp\" (UID: \"edb0e48f-03d9-415d-b7a0-1b1963b772bc\") " pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:31.612662 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.612602    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ttgl\" (UniqueName: \"kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl\") pod \"feast-operator-controller-manager-7b846fcd56-bqrkp\" (UID: \"edb0e48f-03d9-415d-b7a0-1b1963b772bc\") " pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:31.622264 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.622236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ttgl\" (UniqueName: \"kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl\") pod \"feast-operator-controller-manager-7b846fcd56-bqrkp\" (UID: \"edb0e48f-03d9-415d-b7a0-1b1963b772bc\") " pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:31.707421 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.707313    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:31.833692 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.833661    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:03:31.836305 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:03:31.836275    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb0e48f_03d9_415d_b7a0_1b1963b772bc.slice/crio-156b4d8fffdf5dc08a69d27e001ba5f99a9c432e931febc2149ca6cd333bc992 WatchSource:0}: Error finding container 156b4d8fffdf5dc08a69d27e001ba5f99a9c432e931febc2149ca6cd333bc992: Status 404 returned error can't find the container with id 156b4d8fffdf5dc08a69d27e001ba5f99a9c432e931febc2149ca6cd333bc992
May 26 07:03:31.838149 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:31.838130    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:03:32.650362 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:32.650325    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" event={"ID":"edb0e48f-03d9-415d-b7a0-1b1963b772bc","Type":"ContainerStarted","Data":"156b4d8fffdf5dc08a69d27e001ba5f99a9c432e931febc2149ca6cd333bc992"}
May 26 07:03:35.660570 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:35.660533    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" event={"ID":"edb0e48f-03d9-415d-b7a0-1b1963b772bc","Type":"ContainerStarted","Data":"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"}
May 26 07:03:35.660939 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:35.660654    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:03:35.677632 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:35.677589    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" podStartSLOduration=1.7998844630000002 podStartE2EDuration="4.677576424s" podCreationTimestamp="2026-05-26 07:03:31 +0000 UTC" firstStartedPulling="2026-05-26 07:03:31.838316733 +0000 UTC m=+394.059171119" lastFinishedPulling="2026-05-26 07:03:34.716008683 +0000 UTC m=+396.936863080" observedRunningTime="2026-05-26 07:03:35.67548795 +0000 UTC m=+397.896342355" watchObservedRunningTime="2026-05-26 07:03:35.677576424 +0000 UTC m=+397.898430829"
May 26 07:03:46.665210 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:03:46.665171    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:04:14.075304 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.075218    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:04:14.078202 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.078182    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.080933 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.080891    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 07:04:14.080933 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.080909    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 07:04:14.080933 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.080919    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 07:04:14.080933 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.080923    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 07:04:14.081191 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.080891    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 07:04:14.081191 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.081181    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ljdgn\""
May 26 07:04:14.081631 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.081614    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 07:04:14.081733 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.081649    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 07:04:14.091189 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.091168    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:04:14.144890 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.144853    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.144890 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.144894    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.145090 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.144922    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.145090 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.144969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.145090 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.144997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbh7j\" (UniqueName: \"kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.145090 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.145026    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246212 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246175    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246212 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246218    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246252    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246274    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246290    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbh7j\" (UniqueName: \"kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246314    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246319    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246389    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls podName:25b9772a-dce0-4b97-b281-fef128723268 nodeName:}" failed. No retries permitted until 2026-05-26 07:04:14.746366102 +0000 UTC m=+436.967220487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls") pod "feast-simple-feast-setup-5bd9b7594-n9p99" (UID: "25b9772a-dce0-4b97-b281-fef128723268") : secret "feast-simple-feast-setup-offline-tls" not found
May 26 07:04:14.246477 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246446    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 07:04:14.246730 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246486    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls podName:25b9772a-dce0-4b97-b281-fef128723268 nodeName:}" failed. No retries permitted until 2026-05-26 07:04:14.746476362 +0000 UTC m=+436.967330752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls") pod "feast-simple-feast-setup-5bd9b7594-n9p99" (UID: "25b9772a-dce0-4b97-b281-fef128723268") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 07:04:14.246730 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246446    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 07:04:14.246730 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:04:14.246514    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls podName:25b9772a-dce0-4b97-b281-fef128723268 nodeName:}" failed. No retries permitted until 2026-05-26 07:04:14.746508399 +0000 UTC m=+436.967362782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls") pod "feast-simple-feast-setup-5bd9b7594-n9p99" (UID: "25b9772a-dce0-4b97-b281-fef128723268") : secret "feast-simple-feast-setup-online-tls" not found
May 26 07:04:14.246730 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.246688    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.248722 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.248699    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.255111 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.255070    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbh7j\" (UniqueName: \"kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.749797 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.749757    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.749991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.749844    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.749991 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.749866    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.752287 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.752253    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.752287 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.752267    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:14.752463 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:14.752302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-n9p99\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:15.004965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:15.004888    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:04:15.141431 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:15.141388    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:04:15.142820 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:04:15.142792    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25b9772a_dce0_4b97_b281_fef128723268.slice/crio-0cf44158a8b0563cee88d057c424f040d83f2e9c2078d9333b70c292382b59ff WatchSource:0}: Error finding container 0cf44158a8b0563cee88d057c424f040d83f2e9c2078d9333b70c292382b59ff: Status 404 returned error can't find the container with id 0cf44158a8b0563cee88d057c424f040d83f2e9c2078d9333b70c292382b59ff
May 26 07:04:15.771028 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:15.770986    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"0cf44158a8b0563cee88d057c424f040d83f2e9c2078d9333b70c292382b59ff"}
May 26 07:04:49.875626 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:49.875564    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"}
May 26 07:04:53.887998 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:53.887967    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450" exitCode=0
May 26 07:04:53.888345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:53.888020    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"}
May 26 07:04:54.892005 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:54.891968    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"}
May 26 07:04:59.908236 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:59.908199    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b" exitCode=0
May 26 07:04:59.908675 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:59.908242    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"}
May 26 07:04:59.918201 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:04:59.918181    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 07:05:00.916479 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:00.916433    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"}
May 26 07:05:00.916960 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:00.916491    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"}
May 26 07:05:00.916960 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:00.916507    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"}
May 26 07:05:00.916960 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:00.916520    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerStarted","Data":"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"}
May 26 07:05:00.941826 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:00.941761    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podStartSLOduration=12.889915744 podStartE2EDuration="46.941741669s" podCreationTimestamp="2026-05-26 07:04:14 +0000 UTC" firstStartedPulling="2026-05-26 07:04:15.144656529 +0000 UTC m=+437.365510912" lastFinishedPulling="2026-05-26 07:04:49.196482442 +0000 UTC m=+471.417336837" observedRunningTime="2026-05-26 07:05:00.940607197 +0000 UTC m=+483.161461602" watchObservedRunningTime="2026-05-26 07:05:00.941741669 +0000 UTC m=+483.162596075"
May 26 07:05:03.006193 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.006140    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:03.006193 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.006194    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:03.006773 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.006210    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:03.006773 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.006224    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:03.008254 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.008218    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 26 07:05:03.008501 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.008252    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 26 07:05:03.008584 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.008251    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
May 26 07:05:03.008584 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:03.008309    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 26 07:05:05.005163 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:05.005119    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:05.005677 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:05.005637    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:05.005677 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:05.005670    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:05.005796 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:05.005685    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.006668 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.006636    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.007143 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.007020    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.007143 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.007144    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.011325 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.011304    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.936306 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.936270    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.936532 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.936385    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.936532 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.936484    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:06.938684 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:06.938670    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:05:14.826464 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:14.826433    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-bdc4f9f46-99fct"]
May 26 07:05:14.953557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:14.953515    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdc4f9f46-99fct"]
May 26 07:05:14.953737 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:14.953648    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.088895 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.088807    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lt5\" (UniqueName: \"kubernetes.io/projected/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-kube-api-access-k7lt5\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.088895 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.088848    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.089097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.088944    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-oauth-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.089097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.088974    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-service-ca\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.089097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.088997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-oauth-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.089097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.089021    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.089097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.089045    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-trusted-ca-bundle\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.190307 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.190267    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.190591 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.190572    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-trusted-ca-bundle\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.190790 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.190774    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lt5\" (UniqueName: \"kubernetes.io/projected/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-kube-api-access-k7lt5\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.190909 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.190894    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.191044 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.191028    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-oauth-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.191195 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.191174    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-service-ca\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.191317 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.191300    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-oauth-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.191489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.191460    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-trusted-ca-bundle\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.192121 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.192097    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-oauth-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.192224 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.192154    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-service-ca\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.192658 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.192633    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.194467 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.194446    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-serving-cert\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.194787 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.194767    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-console-oauth-config\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.199587 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.199566    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lt5\" (UniqueName: \"kubernetes.io/projected/0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc-kube-api-access-k7lt5\") pod \"console-bdc4f9f46-99fct\" (UID: \"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc\") " pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.263375 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.263335    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:15.389925 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.389887    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdc4f9f46-99fct"]
May 26 07:05:15.394092 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:05:15.394061    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0f2d90_08eb_4f7d_ba3e_b618fd31abdc.slice/crio-5cf3d6366cff111fc46651e5e73660c07e61983b814dc966537ec443779ae643 WatchSource:0}: Error finding container 5cf3d6366cff111fc46651e5e73660c07e61983b814dc966537ec443779ae643: Status 404 returned error can't find the container with id 5cf3d6366cff111fc46651e5e73660c07e61983b814dc966537ec443779ae643
May 26 07:05:15.963635 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.963595    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc4f9f46-99fct" event={"ID":"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc","Type":"ContainerStarted","Data":"c2ff187aeb3f4d49596853767aa2a13b8eff8195ebb75375c2682bcc566e3a8d"}
May 26 07:05:15.963635 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.963633    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdc4f9f46-99fct" event={"ID":"0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc","Type":"ContainerStarted","Data":"5cf3d6366cff111fc46651e5e73660c07e61983b814dc966537ec443779ae643"}
May 26 07:05:15.982145 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:15.982099    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-bdc4f9f46-99fct" podStartSLOduration=1.98208414 podStartE2EDuration="1.98208414s" podCreationTimestamp="2026-05-26 07:05:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:05:15.980899955 +0000 UTC m=+498.201754616" watchObservedRunningTime="2026-05-26 07:05:15.98208414 +0000 UTC m=+498.202938545"
May 26 07:05:25.264517 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:25.264472    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:25.264975 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:25.264550    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:25.269492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:25.269463    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:25.997259 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:25.997229    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bdc4f9f46-99fct"
May 26 07:05:26.040167 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:26.040131    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:05:51.060123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.060068    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c68bbd755-bdrgc" podUID="d7612e2c-20f1-4d07-8006-059913f23184" containerName="console" containerID="cri-o://29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c" gracePeriod=15
May 26 07:05:51.303615 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.303588    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c68bbd755-bdrgc_d7612e2c-20f1-4d07-8006-059913f23184/console/0.log"
May 26 07:05:51.303743 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.303653    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:05:51.400004 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.399970    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400170 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400018    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400170 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400046    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plx96\" (UniqueName: \"kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400247 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400220    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400309 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400267    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400361 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400314    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400443 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400368    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca\") pod \"d7612e2c-20f1-4d07-8006-059913f23184\" (UID: \"d7612e2c-20f1-4d07-8006-059913f23184\") "
May 26 07:05:51.400527 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400383    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:05:51.400616 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400591    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config" (OuterVolumeSpecName: "console-config") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:05:51.400717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400692    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:05:51.400832 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400788    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-oauth-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.400832 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400812    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-console-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.400832 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.400821    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:05:51.402280 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.402260    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:05:51.402346 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.402285    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:05:51.402461 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.402381    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96" (OuterVolumeSpecName: "kube-api-access-plx96") pod "d7612e2c-20f1-4d07-8006-059913f23184" (UID: "d7612e2c-20f1-4d07-8006-059913f23184"). InnerVolumeSpecName "kube-api-access-plx96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:05:51.501968 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.501918    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-trusted-ca-bundle\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.501968 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.501962    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-oauth-config\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.501968 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.501975    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7612e2c-20f1-4d07-8006-059913f23184-service-ca\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.501968 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.501986    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7612e2c-20f1-4d07-8006-059913f23184-console-serving-cert\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:51.502236 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:51.501996    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plx96\" (UniqueName: \"kubernetes.io/projected/d7612e2c-20f1-4d07-8006-059913f23184-kube-api-access-plx96\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:05:52.066866 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066838    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c68bbd755-bdrgc_d7612e2c-20f1-4d07-8006-059913f23184/console/0.log"
May 26 07:05:52.067288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066877    2552 generic.go:358] "Generic (PLEG): container finished" podID="d7612e2c-20f1-4d07-8006-059913f23184" containerID="29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c" exitCode=2
May 26 07:05:52.067288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066913    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c68bbd755-bdrgc" event={"ID":"d7612e2c-20f1-4d07-8006-059913f23184","Type":"ContainerDied","Data":"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"}
May 26 07:05:52.067288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066942    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c68bbd755-bdrgc"
May 26 07:05:52.067288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066954    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c68bbd755-bdrgc" event={"ID":"d7612e2c-20f1-4d07-8006-059913f23184","Type":"ContainerDied","Data":"23d4958a7d98b78d060458cc68721baa6ef420fd0977374412c03107e9199c29"}
May 26 07:05:52.067288 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.066971    2552 scope.go:117] "RemoveContainer" containerID="29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"
May 26 07:05:52.081607 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.081588    2552 scope.go:117] "RemoveContainer" containerID="29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"
May 26 07:05:52.081886 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:05:52.081866    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c\": container with ID starting with 29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c not found: ID does not exist" containerID="29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"
May 26 07:05:52.081959 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.081894    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c"} err="failed to get container status \"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c\": rpc error: code = NotFound desc = could not find container \"29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c\": container with ID starting with 29c997d979f4b0d20c476aeaebb129efe00f2a2168151be350ddae6731854b8c not found: ID does not exist"
May 26 07:05:52.093167 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.093143    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:05:52.097105 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.097083    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c68bbd755-bdrgc"]
May 26 07:05:52.449109 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:05:52.449077    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7612e2c-20f1-4d07-8006-059913f23184" path="/var/lib/kubelet/pods/d7612e2c-20f1-4d07-8006-059913f23184/volumes"
May 26 07:06:09.399823 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.399793    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:06:09.400357 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.400227    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="registry" containerID="cri-o://00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1" gracePeriod=30
May 26 07:06:09.400357 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.400255    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui" containerID="cri-o://ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad" gracePeriod=30
May 26 07:06:09.400357 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.400289    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online" containerID="cri-o://720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4" gracePeriod=30
May 26 07:06:09.400357 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.400284    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="offline" containerID="cri-o://df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c" gracePeriod=30
May 26 07:06:09.696905 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.696809    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:06:09.697269 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.697253    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7612e2c-20f1-4d07-8006-059913f23184" containerName="console"
May 26 07:06:09.697336 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.697273    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7612e2c-20f1-4d07-8006-059913f23184" containerName="console"
May 26 07:06:09.697411 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.697387    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7612e2c-20f1-4d07-8006-059913f23184" containerName="console"
May 26 07:06:09.700800 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.700779    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.703436 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.703386    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wx8ml\""
May 26 07:06:09.717158 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.717133    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:06:09.854391 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854359    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.854391 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854410    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.854615 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gttg5\" (UniqueName: \"kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.854615 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854492    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.854615 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854574    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.854766 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.854696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955651 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955566    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955651 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955628    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955657    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955701    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gttg5\" (UniqueName: \"kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955748    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.955776    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:09.955701    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 07:06:09.955865 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:09.955822    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 07:06:09.956148 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:09.955885    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls podName:96ace489-8224-4e46-a9f0-7bc199d393c2 nodeName:}" failed. No retries permitted until 2026-05-26 07:06:10.455861404 +0000 UTC m=+552.676715797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls") pod "feast-simple-feast-setup-5bd9b7594-zt9g6" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 07:06:09.956148 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:09.955913    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls podName:96ace489-8224-4e46-a9f0-7bc199d393c2 nodeName:}" failed. No retries permitted until 2026-05-26 07:06:10.455893701 +0000 UTC m=+552.676748098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls") pod "feast-simple-feast-setup-5bd9b7594-zt9g6" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2") : secret "feast-simple-feast-setup-online-tls" not found
May 26 07:06:09.956229 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.956207    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.958089 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.958058    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.958198 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.958186    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:09.972597 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:09.972570    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gttg5\" (UniqueName: \"kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.124053 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.124023    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad" exitCode=0
May 26 07:06:10.124053 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.124050    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4" exitCode=0
May 26 07:06:10.124207 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.124102    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"}
May 26 07:06:10.124207 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.124140    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"}
May 26 07:06:10.461342 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.461310    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.461694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.461355    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.463677 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.463655    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.463774 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.463658    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") pod \"feast-simple-feast-setup-5bd9b7594-zt9g6\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") " pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.609559 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.609531    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:10.738514 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:10.738487    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:06:10.740703 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:06:10.740676    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96ace489_8224_4e46_a9f0_7bc199d393c2.slice/crio-434750f4fa5d1cf7a5421e6e25bea694d96f8e933cf4acfac8b70c1fa392719a WatchSource:0}: Error finding container 434750f4fa5d1cf7a5421e6e25bea694d96f8e933cf4acfac8b70c1fa392719a: Status 404 returned error can't find the container with id 434750f4fa5d1cf7a5421e6e25bea694d96f8e933cf4acfac8b70c1fa392719a
May 26 07:06:11.128587 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:11.128550    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"9cb5d90315af1c43aad65723e311daa5ebb8fc8edcbdaa40fd9b72e24d9d685a"}
May 26 07:06:11.128587 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:11.128588    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"434750f4fa5d1cf7a5421e6e25bea694d96f8e933cf4acfac8b70c1fa392719a"}
May 26 07:06:16.145314 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:16.145276    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="9cb5d90315af1c43aad65723e311daa5ebb8fc8edcbdaa40fd9b72e24d9d685a" exitCode=0
May 26 07:06:16.145705 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:16.145350    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"9cb5d90315af1c43aad65723e311daa5ebb8fc8edcbdaa40fd9b72e24d9d685a"}
May 26 07:06:16.936250 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:16.936176    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 26 07:06:16.936250 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:16.936202    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 26 07:06:17.149945 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:17.149911    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"45a6c913829c8aaf41cf12666d781b527df5a3acd1ce9748d3b8d710cdd6ca9b"}
May 26 07:06:22.166387 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:22.166351    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="45a6c913829c8aaf41cf12666d781b527df5a3acd1ce9748d3b8d710cdd6ca9b" exitCode=0
May 26 07:06:22.166765 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:22.166425    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"45a6c913829c8aaf41cf12666d781b527df5a3acd1ce9748d3b8d710cdd6ca9b"}
May 26 07:06:23.174121 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:23.174085    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"87168c0b64cf76b24c88a762fb9cd23c892edc644e7fe830b5e07af5e1fe83e4"}
May 26 07:06:23.174597 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:23.174129    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"8bb067152f1f8957cc62e3aaa00a4df53d9f7342f6b1657540d337c503e129ca"}
May 26 07:06:23.174597 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:23.174144    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"7e3b687771501fb6efa71c0c0da9a0c73b952c287fd335da615f2516bec8e693"}
May 26 07:06:23.174597 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:23.174155    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerStarted","Data":"7c1143dd42cda14fac460fd13d4084379708e8e977481ac84c8ae3f7fd291182"}
May 26 07:06:23.198739 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:23.198679    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podStartSLOduration=14.1986513 podStartE2EDuration="14.1986513s" podCreationTimestamp="2026-05-26 07:06:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:06:23.198331949 +0000 UTC m=+565.419186378" watchObservedRunningTime="2026-05-26 07:06:23.1986513 +0000 UTC m=+565.419505706"
May 26 07:06:25.610278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.610183    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:25.610278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.610235    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:25.610278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.610249    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:25.610278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.610262    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:25.612075 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.612036    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
May 26 07:06:25.612075 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.612057    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 26 07:06:25.612272 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.612076    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 07:06:25.612272 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:25.612122    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
May 26 07:06:26.936540 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:26.936221    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 26 07:06:26.936540 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:26.936425    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 26 07:06:28.610624 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.610595    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.610751    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611179 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611101    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611179 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611146    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611179 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611160    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611179 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611173    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611472 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611454    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611617 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611603    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.611658 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.611641    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:28.615206 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:28.615190    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:29.195357 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:29.195329    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:29.198284 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:29.198266    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:06:36.936041 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:36.935988    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 26 07:06:36.936496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:36.936007    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 26 07:06:36.936496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:36.936138    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:06:36.936496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:36.936194    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:06:40.051145 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.051120    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:06:40.128320 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128282    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128320 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128321    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128524 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128352    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128524 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128374    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128524 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128495    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbh7j\" (UniqueName: \"kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128696 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128573    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls\") pod \"25b9772a-dce0-4b97-b281-fef128723268\" (UID: \"25b9772a-dce0-4b97-b281-fef128723268\") "
May 26 07:06:40.128963 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.128931    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data" (OuterVolumeSpecName: "feast-data") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:06:40.130738 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.130714    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls" (OuterVolumeSpecName: "online-tls") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:06:40.130831 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.130740    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:06:40.130904 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.130875    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:06:40.130904 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.130888    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j" (OuterVolumeSpecName: "kube-api-access-fbh7j") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "kube-api-access-fbh7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:06:40.130978 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.130914    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "25b9772a-dce0-4b97-b281-fef128723268" (UID: "25b9772a-dce0-4b97-b281-fef128723268"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229702    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229727    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-offline-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229736    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbh7j\" (UniqueName: \"kubernetes.io/projected/25b9772a-dce0-4b97-b281-fef128723268-kube-api-access-fbh7j\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229747    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-ui-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229757    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25b9772a-dce0-4b97-b281-fef128723268-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.229786 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.229765    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25b9772a-dce0-4b97-b281-fef128723268-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:06:40.232372 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232344    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c" exitCode=137
May 26 07:06:40.232372 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232373    2552 generic.go:358] "Generic (PLEG): container finished" podID="25b9772a-dce0-4b97-b281-fef128723268" containerID="00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1" exitCode=137
May 26 07:06:40.232557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232437    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"
May 26 07:06:40.232557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232435    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"}
May 26 07:06:40.232557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232546    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"}
May 26 07:06:40.232665 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232559    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99" event={"ID":"25b9772a-dce0-4b97-b281-fef128723268","Type":"ContainerDied","Data":"0cf44158a8b0563cee88d057c424f040d83f2e9c2078d9333b70c292382b59ff"}
May 26 07:06:40.232665 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.232573    2552 scope.go:117] "RemoveContainer" containerID="ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"
May 26 07:06:40.240989 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.240970    2552 scope.go:117] "RemoveContainer" containerID="df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"
May 26 07:06:40.248069 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.248049    2552 scope.go:117] "RemoveContainer" containerID="720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"
May 26 07:06:40.254010 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.253987    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:06:40.254992 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.254981    2552 scope.go:117] "RemoveContainer" containerID="00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"
May 26 07:06:40.258555 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.258531    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-n9p99"]
May 26 07:06:40.262315 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.262300    2552 scope.go:117] "RemoveContainer" containerID="4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"
May 26 07:06:40.269046 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.269032    2552 scope.go:117] "RemoveContainer" containerID="bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"
May 26 07:06:40.275555 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.275537    2552 scope.go:117] "RemoveContainer" containerID="ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"
May 26 07:06:40.275802 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.275785    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad\": container with ID starting with ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad not found: ID does not exist" containerID="ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"
May 26 07:06:40.275845 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.275811    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"} err="failed to get container status \"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad\": rpc error: code = NotFound desc = could not find container \"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad\": container with ID starting with ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad not found: ID does not exist"
May 26 07:06:40.275845 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.275831    2552 scope.go:117] "RemoveContainer" containerID="df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"
May 26 07:06:40.276045 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.276026    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c\": container with ID starting with df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c not found: ID does not exist" containerID="df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"
May 26 07:06:40.276085 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276050    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"} err="failed to get container status \"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c\": rpc error: code = NotFound desc = could not find container \"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c\": container with ID starting with df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c not found: ID does not exist"
May 26 07:06:40.276085 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276067    2552 scope.go:117] "RemoveContainer" containerID="720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"
May 26 07:06:40.276259 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.276244    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4\": container with ID starting with 720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4 not found: ID does not exist" containerID="720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"
May 26 07:06:40.276294 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276263    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"} err="failed to get container status \"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4\": rpc error: code = NotFound desc = could not find container \"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4\": container with ID starting with 720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4 not found: ID does not exist"
May 26 07:06:40.276294 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276275    2552 scope.go:117] "RemoveContainer" containerID="00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"
May 26 07:06:40.276557 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.276539    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1\": container with ID starting with 00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1 not found: ID does not exist" containerID="00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"
May 26 07:06:40.276610 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276559    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"} err="failed to get container status \"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1\": rpc error: code = NotFound desc = could not find container \"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1\": container with ID starting with 00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1 not found: ID does not exist"
May 26 07:06:40.276610 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276572    2552 scope.go:117] "RemoveContainer" containerID="4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"
May 26 07:06:40.276754 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.276734    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b\": container with ID starting with 4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b not found: ID does not exist" containerID="4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"
May 26 07:06:40.276794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276760    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"} err="failed to get container status \"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b\": rpc error: code = NotFound desc = could not find container \"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b\": container with ID starting with 4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b not found: ID does not exist"
May 26 07:06:40.276794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276774    2552 scope.go:117] "RemoveContainer" containerID="bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"
May 26 07:06:40.276962 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:06:40.276943    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450\": container with ID starting with bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450 not found: ID does not exist" containerID="bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"
May 26 07:06:40.277017 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276971    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"} err="failed to get container status \"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450\": rpc error: code = NotFound desc = could not find container \"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450\": container with ID starting with bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450 not found: ID does not exist"
May 26 07:06:40.277017 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.276992    2552 scope.go:117] "RemoveContainer" containerID="ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"
May 26 07:06:40.277221 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277202    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad"} err="failed to get container status \"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad\": rpc error: code = NotFound desc = could not find container \"ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad\": container with ID starting with ddc6f248cf4865f062ab5c57faa343428fdd6aab42b3b09d2971e75c9dcc45ad not found: ID does not exist"
May 26 07:06:40.277267 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277221    2552 scope.go:117] "RemoveContainer" containerID="df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"
May 26 07:06:40.277371 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277357    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c"} err="failed to get container status \"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c\": rpc error: code = NotFound desc = could not find container \"df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c\": container with ID starting with df278ee0874e4160621b86384b86ef8721dedd41d839cc7ca6960ed070cf679c not found: ID does not exist"
May 26 07:06:40.277434 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277371    2552 scope.go:117] "RemoveContainer" containerID="720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"
May 26 07:06:40.277620 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277600    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4"} err="failed to get container status \"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4\": rpc error: code = NotFound desc = could not find container \"720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4\": container with ID starting with 720a63ea68165fb2b03392a4c0aff66c113b07c50fd71bf7e2c0bb3f8bbf49c4 not found: ID does not exist"
May 26 07:06:40.277674 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277620    2552 scope.go:117] "RemoveContainer" containerID="00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"
May 26 07:06:40.277836 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277819    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1"} err="failed to get container status \"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1\": rpc error: code = NotFound desc = could not find container \"00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1\": container with ID starting with 00ad0cbf877bc638f8e452ef37676f1f46f71efcb7dce86a3fd69ba152c547d1 not found: ID does not exist"
May 26 07:06:40.277885 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.277837    2552 scope.go:117] "RemoveContainer" containerID="4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"
May 26 07:06:40.278052 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.278029    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b"} err="failed to get container status \"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b\": rpc error: code = NotFound desc = could not find container \"4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b\": container with ID starting with 4b7547a971788bb782ca29c968e9d71bd206ee2048d27d4f2af6b8e79ec8965b not found: ID does not exist"
May 26 07:06:40.278123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.278054    2552 scope.go:117] "RemoveContainer" containerID="bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"
May 26 07:06:40.278260 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.278245    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450"} err="failed to get container status \"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450\": rpc error: code = NotFound desc = could not find container \"bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450\": container with ID starting with bff0a4ca098a307feac0ec8c775ce291f8a93797ab8b5978130d795150182450 not found: ID does not exist"
May 26 07:06:40.449195 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:40.449158    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b9772a-dce0-4b97-b281-fef128723268" path="/var/lib/kubelet/pods/25b9772a-dce0-4b97-b281-fef128723268/volumes"
May 26 07:06:58.345758 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:58.345729    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:06:58.346947 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:58.346929    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:06:58.350279 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:58.350248    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:06:58.351331 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:06:58.351313    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:07:31.278049 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.277969    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278265    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="offline"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278277    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="offline"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278287    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="registry"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278292    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="registry"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278298    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278304    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278316    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="feast-apply"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278321    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="feast-apply"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278331    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="feast-init"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278337    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="feast-init"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278346    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278351    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278424    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="ui"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278432    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="registry"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278439    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="online"
May 26 07:07:31.280747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.278448    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="25b9772a-dce0-4b97-b281-fef128723268" containerName="offline"
May 26 07:07:31.281674 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.281658    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.284377 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284355    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 07:07:31.284522 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284373    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 07:07:31.284522 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284388    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 26 07:07:31.284522 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284504    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 07:07:31.284522 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284516    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 07:07:31.284739 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284508    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 07:07:31.284739 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284630    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 07:07:31.284906 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.284888    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-b4flq\""
May 26 07:07:31.292757 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.292737    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:07:31.352906 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.352872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwh9j\" (UniqueName: \"kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.352906 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.352908    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.353119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.352941    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.353119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.353029    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.353119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.353073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.353119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.353106    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454095 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454068    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwh9j\" (UniqueName: \"kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454100    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454134    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454211    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454248    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454273    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454588 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:07:31.454371    2552 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 07:07:31.454588 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:07:31.454466    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls podName:3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc nodeName:}" failed. No retries permitted until 2026-05-26 07:07:31.954443564 +0000 UTC m=+634.175297952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls") pod "feast-simple-feast-remote-setup-84b5b6489c-8nfv5" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 07:07:31.454588 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454522    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.454956 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.454937    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.456697 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.456680    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.456752 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.456701    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.462297 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.462279    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwh9j\" (UniqueName: \"kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.958218 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.958172    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:31.960577 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:31.960556    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") pod \"feast-simple-feast-remote-setup-84b5b6489c-8nfv5\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:32.191744 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:32.191703    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:32.326291 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:32.326266    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:07:32.328035 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:07:32.328009    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3142c3fe_66ba_4eaf_a3d8_09d75e2bd4cc.slice/crio-ab0d628f03b2e008a67a1b3c1bf9fa72455e96afd1b572d595866e7a3dac0ee3 WatchSource:0}: Error finding container ab0d628f03b2e008a67a1b3c1bf9fa72455e96afd1b572d595866e7a3dac0ee3: Status 404 returned error can't find the container with id ab0d628f03b2e008a67a1b3c1bf9fa72455e96afd1b572d595866e7a3dac0ee3
May 26 07:07:32.384965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:32.384932    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"ab0d628f03b2e008a67a1b3c1bf9fa72455e96afd1b572d595866e7a3dac0ee3"}
May 26 07:07:33.389205 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:33.389159    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"83f3e6dc54caf90af04d19b7c5e55a8a5d95f563486a22371f8a256129b4efbd"}
May 26 07:07:37.401515 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:37.401484    2552 generic.go:358] "Generic (PLEG): container finished" podID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerID="83f3e6dc54caf90af04d19b7c5e55a8a5d95f563486a22371f8a256129b4efbd" exitCode=0
May 26 07:07:37.401885 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:37.401531    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"83f3e6dc54caf90af04d19b7c5e55a8a5d95f563486a22371f8a256129b4efbd"}
May 26 07:07:38.406585 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:38.406549    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"9140423aad62925c8c50f473e451a74ac2c60a3a82f33eabbb8fd52b1430720f"}
May 26 07:07:43.421946 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:43.421910    2552 generic.go:358] "Generic (PLEG): container finished" podID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerID="9140423aad62925c8c50f473e451a74ac2c60a3a82f33eabbb8fd52b1430720f" exitCode=0
May 26 07:07:43.422311 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:43.422000    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"9140423aad62925c8c50f473e451a74ac2c60a3a82f33eabbb8fd52b1430720f"}
May 26 07:07:44.428012 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:44.427973    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"edf3a06f04f520d6a779fe01cb68717ff4a015b23a48c7e02bb04f40ba457bdf"}
May 26 07:07:44.428425 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:44.428021    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"e6dbfe6acce2f0537542b80e6c16f053733d7eb04027bbf6a6f7e222ad3ed0e5"}
May 26 07:07:44.428425 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:44.428037    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerStarted","Data":"0418f3953262361e6341c0d4094c91678dfc42ea09cefb46841aed88f4ddd38e"}
May 26 07:07:44.453203 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:44.453142    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podStartSLOduration=13.453123817 podStartE2EDuration="13.453123817s" podCreationTimestamp="2026-05-26 07:07:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:07:44.452735345 +0000 UTC m=+646.673589765" watchObservedRunningTime="2026-05-26 07:07:44.453123817 +0000 UTC m=+646.673978223"
May 26 07:07:47.192054 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.192011    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:47.192600 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.192574    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:47.192600 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.192601    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:47.193450 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.193414    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
May 26 07:07:47.193567 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.193456    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 07:07:47.193567 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:47.193460    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 07:07:50.193664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.193632    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.194111 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.193722    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.194196 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.194118    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.194196 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.194154    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.194325 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.194306    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.194509 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.194492    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.197805 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.197786    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.455159 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.455062    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:07:50.458261 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:07:50.458238    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:08:52.547853 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.547817    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:08:52.548254 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.548229    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online" containerID="cri-o://0418f3953262361e6341c0d4094c91678dfc42ea09cefb46841aed88f4ddd38e" gracePeriod=30
May 26 07:08:52.548320 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.548281    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui" containerID="cri-o://edf3a06f04f520d6a779fe01cb68717ff4a015b23a48c7e02bb04f40ba457bdf" gracePeriod=30
May 26 07:08:52.548320 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.548287    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="offline" containerID="cri-o://e6dbfe6acce2f0537542b80e6c16f053733d7eb04027bbf6a6f7e222ad3ed0e5" gracePeriod=30
May 26 07:08:52.676167 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.676136    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:08:52.676533 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.676477    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="registry" containerID="cri-o://7c1143dd42cda14fac460fd13d4084379708e8e977481ac84c8ae3f7fd291182" gracePeriod=30
May 26 07:08:52.676680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.676523    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui" containerID="cri-o://87168c0b64cf76b24c88a762fb9cd23c892edc644e7fe830b5e07af5e1fe83e4" gracePeriod=30
May 26 07:08:52.676680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.676547    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online" containerID="cri-o://7e3b687771501fb6efa71c0c0da9a0c73b952c287fd335da615f2516bec8e693" gracePeriod=30
May 26 07:08:52.676680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:52.676529    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="offline" containerID="cri-o://8bb067152f1f8957cc62e3aaa00a4df53d9f7342f6b1657540d337c503e129ca" gracePeriod=30
May 26 07:08:53.641001 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.640974    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="87168c0b64cf76b24c88a762fb9cd23c892edc644e7fe830b5e07af5e1fe83e4" exitCode=0
May 26 07:08:53.641001 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.640999    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="7e3b687771501fb6efa71c0c0da9a0c73b952c287fd335da615f2516bec8e693" exitCode=0
May 26 07:08:53.641374 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.641058    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"87168c0b64cf76b24c88a762fb9cd23c892edc644e7fe830b5e07af5e1fe83e4"}
May 26 07:08:53.641374 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.641094    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"7e3b687771501fb6efa71c0c0da9a0c73b952c287fd335da615f2516bec8e693"}
May 26 07:08:53.643536 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.643514    2552 generic.go:358] "Generic (PLEG): container finished" podID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerID="edf3a06f04f520d6a779fe01cb68717ff4a015b23a48c7e02bb04f40ba457bdf" exitCode=0
May 26 07:08:53.643536 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.643533    2552 generic.go:358] "Generic (PLEG): container finished" podID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerID="0418f3953262361e6341c0d4094c91678dfc42ea09cefb46841aed88f4ddd38e" exitCode=0
May 26 07:08:53.643656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.643550    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"edf3a06f04f520d6a779fe01cb68717ff4a015b23a48c7e02bb04f40ba457bdf"}
May 26 07:08:53.643656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:53.643569    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"0418f3953262361e6341c0d4094c91678dfc42ea09cefb46841aed88f4ddd38e"}
May 26 07:08:58.612132 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:58.612080    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 26 07:08:59.195515 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:08:59.195471    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 07:09:00.195243 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:00.195195    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 07:09:00.455576 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:00.455495    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 07:09:08.611582 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:08.611540    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 26 07:09:09.195636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:09.195595    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 07:09:10.194564 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:10.194515    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 07:09:10.455492 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:10.455382    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 07:09:18.612049 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:18.611987    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 26 07:09:18.612496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:18.612142    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:09:19.195861 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:19.195824    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 07:09:19.196026 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:19.195938    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:09:20.195098 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:20.195041    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 07:09:20.195588 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:20.195172    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:09:20.455607 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:20.455520    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 07:09:20.455755 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:20.455625    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:09:22.730551 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.730515    2552 generic.go:358] "Generic (PLEG): container finished" podID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerID="e6dbfe6acce2f0537542b80e6c16f053733d7eb04027bbf6a6f7e222ad3ed0e5" exitCode=137
May 26 07:09:22.730883 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.730585    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"e6dbfe6acce2f0537542b80e6c16f053733d7eb04027bbf6a6f7e222ad3ed0e5"}
May 26 07:09:22.733407 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.733370    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="8bb067152f1f8957cc62e3aaa00a4df53d9f7342f6b1657540d337c503e129ca" exitCode=137
May 26 07:09:22.733505 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.733389    2552 generic.go:358] "Generic (PLEG): container finished" podID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerID="7c1143dd42cda14fac460fd13d4084379708e8e977481ac84c8ae3f7fd291182" exitCode=137
May 26 07:09:22.733505 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.733432    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"8bb067152f1f8957cc62e3aaa00a4df53d9f7342f6b1657540d337c503e129ca"}
May 26 07:09:22.733505 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:22.733464    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"7c1143dd42cda14fac460fd13d4084379708e8e977481ac84c8ae3f7fd291182"}
May 26 07:09:23.196938 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.196910    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:09:23.290051 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290015    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290222 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290089    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwh9j\" (UniqueName: \"kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290222 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290113    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290222 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290137    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290222 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290186    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290440 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290222    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls\") pod \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\" (UID: \"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc\") "
May 26 07:09:23.290574 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290526    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 07:09:23.290792 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.290745    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data" (OuterVolumeSpecName: "feast-data") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:09:23.292333 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.292303    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.292459 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.292326    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.292459 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.292389    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls" (OuterVolumeSpecName: "online-tls") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.292578 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.292464    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j" (OuterVolumeSpecName: "kube-api-access-zwh9j") pod "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" (UID: "3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc"). InnerVolumeSpecName "kube-api-access-zwh9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:09:23.326491 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.326467    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:09:23.391192 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391156    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391382 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391204    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391382 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391228    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391382 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391251    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391577 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391378    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391577 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391483    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gttg5\" (UniqueName: \"kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5\") pod \"96ace489-8224-4e46-a9f0-7bc199d393c2\" (UID: \"96ace489-8224-4e46-a9f0-7bc199d393c2\") "
May 26 07:09:23.391768 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391748    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwh9j\" (UniqueName: \"kubernetes.io/projected/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-kube-api-access-zwh9j\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.391823 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391775    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.391823 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391789    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-offline-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.391823 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391801    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.391823 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391813    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.392023 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391824    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc-ui-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.392023 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.391934    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data" (OuterVolumeSpecName: "feast-data") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:09:23.393556 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.393521    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.393556 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.393545    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.393712 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.393550    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5" (OuterVolumeSpecName: "kube-api-access-gttg5") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "kube-api-access-gttg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:09:23.393762 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.393747    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.393813 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.393797    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls" (OuterVolumeSpecName: "online-tls") pod "96ace489-8224-4e46-a9f0-7bc199d393c2" (UID: "96ace489-8224-4e46-a9f0-7bc199d393c2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:09:23.492766 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492730    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.492766 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492762    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.492766 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492771    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96ace489-8224-4e46-a9f0-7bc199d393c2-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.492969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492781    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gttg5\" (UniqueName: \"kubernetes.io/projected/96ace489-8224-4e46-a9f0-7bc199d393c2-kube-api-access-gttg5\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.492969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492792    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-offline-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.492969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.492800    2552 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96ace489-8224-4e46-a9f0-7bc199d393c2-ui-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:09:23.738231 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.738202    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"
May 26 07:09:23.738711 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.738202    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5" event={"ID":"3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc","Type":"ContainerDied","Data":"ab0d628f03b2e008a67a1b3c1bf9fa72455e96afd1b572d595866e7a3dac0ee3"}
May 26 07:09:23.738711 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.738330    2552 scope.go:117] "RemoveContainer" containerID="edf3a06f04f520d6a779fe01cb68717ff4a015b23a48c7e02bb04f40ba457bdf"
May 26 07:09:23.741062 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.741037    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6" event={"ID":"96ace489-8224-4e46-a9f0-7bc199d393c2","Type":"ContainerDied","Data":"434750f4fa5d1cf7a5421e6e25bea694d96f8e933cf4acfac8b70c1fa392719a"}
May 26 07:09:23.741183 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.741102    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"
May 26 07:09:23.747769 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.747745    2552 scope.go:117] "RemoveContainer" containerID="e6dbfe6acce2f0537542b80e6c16f053733d7eb04027bbf6a6f7e222ad3ed0e5"
May 26 07:09:23.755040 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.755024    2552 scope.go:117] "RemoveContainer" containerID="0418f3953262361e6341c0d4094c91678dfc42ea09cefb46841aed88f4ddd38e"
May 26 07:09:23.761914 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.761893    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:09:23.763204 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.763182    2552 scope.go:117] "RemoveContainer" containerID="9140423aad62925c8c50f473e451a74ac2c60a3a82f33eabbb8fd52b1430720f"
May 26 07:09:23.767203 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.767181    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b5b6489c-8nfv5"]
May 26 07:09:23.770491 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.770470    2552 scope.go:117] "RemoveContainer" containerID="83f3e6dc54caf90af04d19b7c5e55a8a5d95f563486a22371f8a256129b4efbd"
May 26 07:09:23.777018 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.776996    2552 scope.go:117] "RemoveContainer" containerID="87168c0b64cf76b24c88a762fb9cd23c892edc644e7fe830b5e07af5e1fe83e4"
May 26 07:09:23.779198 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.779179    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:09:23.783362 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.783339    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5bd9b7594-zt9g6"]
May 26 07:09:23.785149 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.785134    2552 scope.go:117] "RemoveContainer" containerID="8bb067152f1f8957cc62e3aaa00a4df53d9f7342f6b1657540d337c503e129ca"
May 26 07:09:23.791917 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.791900    2552 scope.go:117] "RemoveContainer" containerID="7e3b687771501fb6efa71c0c0da9a0c73b952c287fd335da615f2516bec8e693"
May 26 07:09:23.798365 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.798347    2552 scope.go:117] "RemoveContainer" containerID="7c1143dd42cda14fac460fd13d4084379708e8e977481ac84c8ae3f7fd291182"
May 26 07:09:23.804759 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.804743    2552 scope.go:117] "RemoveContainer" containerID="45a6c913829c8aaf41cf12666d781b527df5a3acd1ce9748d3b8d710cdd6ca9b"
May 26 07:09:23.812687 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:23.812667    2552 scope.go:117] "RemoveContainer" containerID="9cb5d90315af1c43aad65723e311daa5ebb8fc8edcbdaa40fd9b72e24d9d685a"
May 26 07:09:24.449385 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:24.449354    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" path="/var/lib/kubelet/pods/3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc/volumes"
May 26 07:09:24.449914 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:24.449899    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" path="/var/lib/kubelet/pods/96ace489-8224-4e46-a9f0-7bc199d393c2/volumes"
May 26 07:09:35.657215 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657173    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657510    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="feast-apply"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657523    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="feast-apply"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657532    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="offline"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657537    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="offline"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657548    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657553    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657560    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657568    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657578    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="feast-init"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657584    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="feast-init"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657593    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="feast-init"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657599    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="feast-init"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657604    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657609    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657619    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="registry"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657625    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="registry"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657631    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="feast-apply"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657638    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="feast-apply"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657647    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="offline"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657655    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="offline"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657662    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online"
May 26 07:09:35.657666 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657667    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657711    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="registry"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657721    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="ui"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657732    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="ui"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657738    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="offline"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657744    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="online"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657749    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="3142c3fe-66ba-4eaf-a3d8-09d75e2bd4cc" containerName="offline"
May 26 07:09:35.658324 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.657754    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96ace489-8224-4e46-a9f0-7bc199d393c2" containerName="online"
May 26 07:09:35.662846 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.662826    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.666426 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.666183    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 07:09:35.667680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.666640    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 07:09:35.667680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.666660    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 26 07:09:35.667680 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.667468    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-j8vmb\""
May 26 07:09:35.671193 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.671168    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:09:35.692645 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.692622    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:09:35.695721 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.695704    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:09:35.702684 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.702660    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:09:35.795141 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.795098    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twt42\" (UniqueName: \"kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42\") pod \"redis-854544c579-l6p2b\" (UID: \"a8c4c4ac-6165-49b2-82a2-7b98750023b8\") " pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:09:35.795141 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.795146    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.795351 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.795241    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s7hd\" (UniqueName: \"kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.895965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.895928    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twt42\" (UniqueName: \"kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42\") pod \"redis-854544c579-l6p2b\" (UID: \"a8c4c4ac-6165-49b2-82a2-7b98750023b8\") " pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:09:35.896123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.895977    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.896123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.896053    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s7hd\" (UniqueName: \"kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.896388 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.896370    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.904822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.904800    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twt42\" (UniqueName: \"kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42\") pod \"redis-854544c579-l6p2b\" (UID: \"a8c4c4ac-6165-49b2-82a2-7b98750023b8\") " pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:09:35.904822 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.904811    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s7hd\" (UniqueName: \"kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd\") pod \"postgres-7c7656cc6d-h2njw\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") " pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:35.985424 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:35.985304    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:09:36.006987 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.006961    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:09:36.115815 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.115742    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:09:36.118572 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:09:36.118542    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc967f542_d17f_45d7_87fe_3313a363e240.slice/crio-16322c50be1d046e0507ef98e21fe5c9f7ef52c2809579c712188892182fa2e0 WatchSource:0}: Error finding container 16322c50be1d046e0507ef98e21fe5c9f7ef52c2809579c712188892182fa2e0: Status 404 returned error can't find the container with id 16322c50be1d046e0507ef98e21fe5c9f7ef52c2809579c712188892182fa2e0
May 26 07:09:36.120369 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.120353    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:09:36.135445 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.135419    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:09:36.138269 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:09:36.138246    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8c4c4ac_6165_49b2_82a2_7b98750023b8.slice/crio-cf862d792c3eb9d4d72459fbba6945e40e204788bfc6f16975b302ff8ae0c4e0 WatchSource:0}: Error finding container cf862d792c3eb9d4d72459fbba6945e40e204788bfc6f16975b302ff8ae0c4e0: Status 404 returned error can't find the container with id cf862d792c3eb9d4d72459fbba6945e40e204788bfc6f16975b302ff8ae0c4e0
May 26 07:09:36.778755 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.778675    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" event={"ID":"c967f542-d17f-45d7-87fe-3313a363e240","Type":"ContainerStarted","Data":"16322c50be1d046e0507ef98e21fe5c9f7ef52c2809579c712188892182fa2e0"}
May 26 07:09:36.779862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:36.779832    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-l6p2b" event={"ID":"a8c4c4ac-6165-49b2-82a2-7b98750023b8","Type":"ContainerStarted","Data":"cf862d792c3eb9d4d72459fbba6945e40e204788bfc6f16975b302ff8ae0c4e0"}
May 26 07:09:37.785685 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:37.785644    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-l6p2b" event={"ID":"a8c4c4ac-6165-49b2-82a2-7b98750023b8","Type":"ContainerStarted","Data":"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"}
May 26 07:09:37.802069 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:37.802011    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-l6p2b" podStartSLOduration=1.244768726 podStartE2EDuration="2.801996336s" podCreationTimestamp="2026-05-26 07:09:35 +0000 UTC" firstStartedPulling="2026-05-26 07:09:36.139947295 +0000 UTC m=+758.360801682" lastFinishedPulling="2026-05-26 07:09:37.697174906 +0000 UTC m=+759.918029292" observedRunningTime="2026-05-26 07:09:37.800990778 +0000 UTC m=+760.021845185" watchObservedRunningTime="2026-05-26 07:09:37.801996336 +0000 UTC m=+760.022850741"
May 26 07:09:42.801453 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:42.801420    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" event={"ID":"c967f542-d17f-45d7-87fe-3313a363e240","Type":"ContainerStarted","Data":"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"}
May 26 07:09:42.816346 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:42.816293    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" podStartSLOduration=1.206589071 podStartE2EDuration="7.816279156s" podCreationTimestamp="2026-05-26 07:09:35 +0000 UTC" firstStartedPulling="2026-05-26 07:09:36.120516965 +0000 UTC m=+758.341371348" lastFinishedPulling="2026-05-26 07:09:42.730207046 +0000 UTC m=+764.951061433" observedRunningTime="2026-05-26 07:09:42.814638636 +0000 UTC m=+765.035493042" watchObservedRunningTime="2026-05-26 07:09:42.816279156 +0000 UTC m=+765.037133560"
May 26 07:09:46.380913 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.380879    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:09:46.386276 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.386255    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.388645 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.388618    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 26 07:09:46.388809 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.388618    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 26 07:09:46.388869 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.388822    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 26 07:09:46.388869 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.388843    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-c5m58\""
May 26 07:09:46.389066 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.389052    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 07:09:46.396972 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.396946    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:09:46.484593 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.484557    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.484763 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.484594    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pggzp\" (UniqueName: \"kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.484763 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.484670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.484763 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.484739    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.484964 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.484797    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.585999 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.585960    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.586018    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.586038    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pggzp\" (UniqueName: \"kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.586056    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.586094    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:09:46.586139    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 26 07:09:46.586200 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:09:46.586191    2552 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
May 26 07:09:46.586496 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:09:46.586223    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls podName:96cb4ef6-8ffb-4969-ae02-6b09362ea2ea nodeName:}" failed. No retries permitted until 2026-05-26 07:09:47.086200861 +0000 UTC m=+769.307055255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls") pod "feast-credit-scoring-b888d8998-chgnn" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea") : secret "feast-credit-scoring-online-tls" not found
May 26 07:09:46.586496 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:09:46.586249    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls podName:96cb4ef6-8ffb-4969-ae02-6b09362ea2ea nodeName:}" failed. No retries permitted until 2026-05-26 07:09:47.086232472 +0000 UTC m=+769.307086855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls") pod "feast-credit-scoring-b888d8998-chgnn" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea") : secret "feast-credit-scoring-registry-tls" not found
May 26 07:09:46.586496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.586462    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.588535 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.588514    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:46.594336 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:46.594302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pggzp\" (UniqueName: \"kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.090601 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.090567    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.090779 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.090616    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.093120 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.093089    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.093228 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.093089    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") pod \"feast-credit-scoring-b888d8998-chgnn\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") " pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.295808 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.295773    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:47.429806 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.427466    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:09:47.817624 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.817593    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"}
May 26 07:09:47.817624 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:47.817626    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"a989dd49e7d79ed228c2c63154c5cde93ab26e5a999a2ed514a08aa03f9bc2d0"}
May 26 07:09:48.821527 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:48.821447    2552 generic.go:358] "Generic (PLEG): container finished" podID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerID="f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9" exitCode=0
May 26 07:09:48.821900 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:48.821537    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"}
May 26 07:09:49.826068 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:49.826031    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"}
May 26 07:09:55.846483 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:55.846449    2552 generic.go:358] "Generic (PLEG): container finished" podID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerID="af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468" exitCode=0
May 26 07:09:55.846835 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:55.846521    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"}
May 26 07:09:56.852880 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:56.852845    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"}
May 26 07:09:56.852880 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:56.852885    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"}
May 26 07:09:56.853432 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:56.852894    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerStarted","Data":"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"}
May 26 07:09:56.876415 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:56.876346    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podStartSLOduration=10.876327378 podStartE2EDuration="10.876327378s" podCreationTimestamp="2026-05-26 07:09:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:09:56.874699857 +0000 UTC m=+779.095554275" watchObservedRunningTime="2026-05-26 07:09:56.876327378 +0000 UTC m=+779.097181782"
May 26 07:09:57.296862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:57.296766    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:57.296862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:57.296810    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:57.296862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:57.296819    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:59.296489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.296449    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:59.296908 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.296498    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:59.296908 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.296512    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:09:59.298355 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.298315    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused"
May 26 07:09:59.298507 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.298350    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 07:09:59.298507 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:09:59.298334    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 07:10:02.296985 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:02.296939    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 07:10:02.297599 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:02.297579    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:10:02.298466 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:02.298443    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:10:02.302165 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:02.302144    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:10:02.874777 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:02.874743    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:10:05.296707 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:05.296655    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 07:10:08.297038 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:08.296966    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:10:08.297610 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:10:08.297592    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:11:12.356335 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.356291    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:11:12.356873 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.356667    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry" containerID="cri-o://19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e" gracePeriod=30
May 26 07:11:12.356873 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.356730    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="offline" containerID="cri-o://7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6" gracePeriod=30
May 26 07:11:12.356873 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.356690    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" containerID="cri-o://cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9" gracePeriod=30
May 26 07:11:12.377002 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.376974    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:11:12.377169 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.377149    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" podUID="c967f542-d17f-45d7-87fe-3313a363e240" containerName="postgres" containerID="cri-o://1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677" gracePeriod=30
May 26 07:11:12.387212 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.387186    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:11:12.387361 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.387342    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-l6p2b" podUID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" containerName="redis" containerID="cri-o://43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5" gracePeriod=30
May 26 07:11:12.643850 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.643828    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:11:12.647011 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.646984    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:11:12.703534 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.703503    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twt42\" (UniqueName: \"kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42\") pod \"a8c4c4ac-6165-49b2-82a2-7b98750023b8\" (UID: \"a8c4c4ac-6165-49b2-82a2-7b98750023b8\") "
May 26 07:11:12.703686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.703592    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata\") pod \"c967f542-d17f-45d7-87fe-3313a363e240\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") "
May 26 07:11:12.703686 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.703618    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s7hd\" (UniqueName: \"kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd\") pod \"c967f542-d17f-45d7-87fe-3313a363e240\" (UID: \"c967f542-d17f-45d7-87fe-3313a363e240\") "
May 26 07:11:12.705770 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.705736    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd" (OuterVolumeSpecName: "kube-api-access-2s7hd") pod "c967f542-d17f-45d7-87fe-3313a363e240" (UID: "c967f542-d17f-45d7-87fe-3313a363e240"). InnerVolumeSpecName "kube-api-access-2s7hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:11:12.705961 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.705938    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42" (OuterVolumeSpecName: "kube-api-access-twt42") pod "a8c4c4ac-6165-49b2-82a2-7b98750023b8" (UID: "a8c4c4ac-6165-49b2-82a2-7b98750023b8"). InnerVolumeSpecName "kube-api-access-twt42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:11:12.733784 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.733755    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "c967f542-d17f-45d7-87fe-3313a363e240" (UID: "c967f542-d17f-45d7-87fe-3313a363e240"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:11:12.804736 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.804697    2552 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c967f542-d17f-45d7-87fe-3313a363e240-postgresdata\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:12.804736 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.804736    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s7hd\" (UniqueName: \"kubernetes.io/projected/c967f542-d17f-45d7-87fe-3313a363e240-kube-api-access-2s7hd\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:12.804935 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.804754    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twt42\" (UniqueName: \"kubernetes.io/projected/a8c4c4ac-6165-49b2-82a2-7b98750023b8-kube-api-access-twt42\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:12.872119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:12.872070    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 07:11:13.076230 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.076201    2552 generic.go:358] "Generic (PLEG): container finished" podID="c967f542-d17f-45d7-87fe-3313a363e240" containerID="1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677" exitCode=0
May 26 07:11:13.076366 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.076247    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-h2njw"
May 26 07:11:13.076366 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.076280    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" event={"ID":"c967f542-d17f-45d7-87fe-3313a363e240","Type":"ContainerDied","Data":"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"}
May 26 07:11:13.076366 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.076318    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-h2njw" event={"ID":"c967f542-d17f-45d7-87fe-3313a363e240","Type":"ContainerDied","Data":"16322c50be1d046e0507ef98e21fe5c9f7ef52c2809579c712188892182fa2e0"}
May 26 07:11:13.076366 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.076334    2552 scope.go:117] "RemoveContainer" containerID="1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"
May 26 07:11:13.078818 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.078798    2552 generic.go:358] "Generic (PLEG): container finished" podID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerID="cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9" exitCode=0
May 26 07:11:13.078922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.078856    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"}
May 26 07:11:13.079980 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.079955    2552 generic.go:358] "Generic (PLEG): container finished" podID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" containerID="43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5" exitCode=0
May 26 07:11:13.080097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.079995    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-l6p2b"
May 26 07:11:13.080097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.080034    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-l6p2b" event={"ID":"a8c4c4ac-6165-49b2-82a2-7b98750023b8","Type":"ContainerDied","Data":"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"}
May 26 07:11:13.080097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.080057    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-l6p2b" event={"ID":"a8c4c4ac-6165-49b2-82a2-7b98750023b8","Type":"ContainerDied","Data":"cf862d792c3eb9d4d72459fbba6945e40e204788bfc6f16975b302ff8ae0c4e0"}
May 26 07:11:13.088611 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.084501    2552 scope.go:117] "RemoveContainer" containerID="1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"
May 26 07:11:13.088986 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:13.088960    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677\": container with ID starting with 1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677 not found: ID does not exist" containerID="1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"
May 26 07:11:13.089149 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.088996    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677"} err="failed to get container status \"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677\": rpc error: code = NotFound desc = could not find container \"1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677\": container with ID starting with 1d36c8ad9b08031f808c9e3194eccfa144d7bb828630ee5bef9655cd2fe17677 not found: ID does not exist"
May 26 07:11:13.089263 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.089155    2552 scope.go:117] "RemoveContainer" containerID="43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"
May 26 07:11:13.097079 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.097064    2552 scope.go:117] "RemoveContainer" containerID="43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"
May 26 07:11:13.097322 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:13.097303    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5\": container with ID starting with 43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5 not found: ID does not exist" containerID="43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"
May 26 07:11:13.097382 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.097329    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5"} err="failed to get container status \"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5\": rpc error: code = NotFound desc = could not find container \"43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5\": container with ID starting with 43967d3ab3cfa9833f241ef34c46ee78cf423174fbc3a068db73e67b156291e5 not found: ID does not exist"
May 26 07:11:13.104173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.104153    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:11:13.107795 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.107773    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-h2njw"]
May 26 07:11:13.117875 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.117853    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:11:13.120929 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:13.120911    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-l6p2b"]
May 26 07:11:14.449363 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:14.449334    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" path="/var/lib/kubelet/pods/a8c4c4ac-6165-49b2-82a2-7b98750023b8/volumes"
May 26 07:11:14.449717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:14.449676    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c967f542-d17f-45d7-87fe-3313a363e240" path="/var/lib/kubelet/pods/c967f542-d17f-45d7-87fe-3313a363e240/volumes"
May 26 07:11:22.872249 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:22.872204    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 07:11:32.872302 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:32.872254    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 07:11:32.872704 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:32.872425    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:11:42.872300 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:42.872269    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 07:11:43.003368 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.003341    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:11:43.147341 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.147261    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") pod \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") "
May 26 07:11:43.147341 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.147322    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pggzp\" (UniqueName: \"kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp\") pod \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") "
May 26 07:11:43.147580 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.147376    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") pod \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") "
May 26 07:11:43.147580 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.147421    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls\") pod \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") "
May 26 07:11:43.147580 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.147461    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data\") pod \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\" (UID: \"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea\") "
May 26 07:11:43.149371 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.149329    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls" (OuterVolumeSpecName: "online-tls") pod "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:11:43.149371 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.149357    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:11:43.149561 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.149381    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:11:43.149687 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.149671    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp" (OuterVolumeSpecName: "kube-api-access-pggzp") pod "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea"). InnerVolumeSpecName "kube-api-access-pggzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:11:43.155762 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.155734    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data" (OuterVolumeSpecName: "feast-data") pod "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" (UID: "96cb4ef6-8ffb-4969-ae02-6b09362ea2ea"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:11:43.167310 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167286    2552 generic.go:358] "Generic (PLEG): container finished" podID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerID="7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6" exitCode=137
May 26 07:11:43.167310 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167307    2552 generic.go:358] "Generic (PLEG): container finished" podID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerID="19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e" exitCode=137
May 26 07:11:43.167499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167360    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn"
May 26 07:11:43.167499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167363    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"}
May 26 07:11:43.167499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167418    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"}
May 26 07:11:43.167499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167435    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-b888d8998-chgnn" event={"ID":"96cb4ef6-8ffb-4969-ae02-6b09362ea2ea","Type":"ContainerDied","Data":"a989dd49e7d79ed228c2c63154c5cde93ab26e5a999a2ed514a08aa03f9bc2d0"}
May 26 07:11:43.167499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.167454    2552 scope.go:117] "RemoveContainer" containerID="7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"
May 26 07:11:43.177627 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.177608    2552 scope.go:117] "RemoveContainer" containerID="cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"
May 26 07:11:43.184464 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.184447    2552 scope.go:117] "RemoveContainer" containerID="19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"
May 26 07:11:43.192127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.192100    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:11:43.192847 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.192825    2552 scope.go:117] "RemoveContainer" containerID="af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"
May 26 07:11:43.195598 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.195574    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-b888d8998-chgnn"]
May 26 07:11:43.199692 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.199677    2552 scope.go:117] "RemoveContainer" containerID="f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"
May 26 07:11:43.205938 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.205921    2552 scope.go:117] "RemoveContainer" containerID="7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"
May 26 07:11:43.206196 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:43.206171    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6\": container with ID starting with 7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6 not found: ID does not exist" containerID="7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"
May 26 07:11:43.206293 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206197    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"} err="failed to get container status \"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6\": rpc error: code = NotFound desc = could not find container \"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6\": container with ID starting with 7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6 not found: ID does not exist"
May 26 07:11:43.206293 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206214    2552 scope.go:117] "RemoveContainer" containerID="cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"
May 26 07:11:43.206458 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:43.206437    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9\": container with ID starting with cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9 not found: ID does not exist" containerID="cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"
May 26 07:11:43.206529 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206469    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"} err="failed to get container status \"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9\": rpc error: code = NotFound desc = could not find container \"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9\": container with ID starting with cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9 not found: ID does not exist"
May 26 07:11:43.206529 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206495    2552 scope.go:117] "RemoveContainer" containerID="19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"
May 26 07:11:43.206732 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:43.206717    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e\": container with ID starting with 19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e not found: ID does not exist" containerID="19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"
May 26 07:11:43.206781 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206738    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"} err="failed to get container status \"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e\": rpc error: code = NotFound desc = could not find container \"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e\": container with ID starting with 19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e not found: ID does not exist"
May 26 07:11:43.206781 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206757    2552 scope.go:117] "RemoveContainer" containerID="af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"
May 26 07:11:43.206929 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:43.206909    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468\": container with ID starting with af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468 not found: ID does not exist" containerID="af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"
May 26 07:11:43.206969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206933    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"} err="failed to get container status \"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468\": rpc error: code = NotFound desc = could not find container \"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468\": container with ID starting with af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468 not found: ID does not exist"
May 26 07:11:43.206969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.206945    2552 scope.go:117] "RemoveContainer" containerID="f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"
May 26 07:11:43.207132 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:11:43.207116    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9\": container with ID starting with f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9 not found: ID does not exist" containerID="f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"
May 26 07:11:43.207201 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207139    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"} err="failed to get container status \"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9\": rpc error: code = NotFound desc = could not find container \"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9\": container with ID starting with f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9 not found: ID does not exist"
May 26 07:11:43.207201 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207158    2552 scope.go:117] "RemoveContainer" containerID="7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"
May 26 07:11:43.207439 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207376    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6"} err="failed to get container status \"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6\": rpc error: code = NotFound desc = could not find container \"7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6\": container with ID starting with 7d701d9e6be6088aec038ec5f39d7ff3cbf76c2037daa9a7eeef5eff6e42d1a6 not found: ID does not exist"
May 26 07:11:43.207439 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207413    2552 scope.go:117] "RemoveContainer" containerID="cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"
May 26 07:11:43.207595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207579    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9"} err="failed to get container status \"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9\": rpc error: code = NotFound desc = could not find container \"cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9\": container with ID starting with cdd8eec305cc5d4fc03ddfc377d6cdb0e905e44cf8963522122d408de79570e9 not found: ID does not exist"
May 26 07:11:43.207638 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207597    2552 scope.go:117] "RemoveContainer" containerID="19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"
May 26 07:11:43.207793 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207776    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e"} err="failed to get container status \"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e\": rpc error: code = NotFound desc = could not find container \"19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e\": container with ID starting with 19c088bbf341d1647cba9e8af77fa28d44ebf58cda45f48d9e19688b58b32c8e not found: ID does not exist"
May 26 07:11:43.207832 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207794    2552 scope.go:117] "RemoveContainer" containerID="af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"
May 26 07:11:43.207977 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207963    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468"} err="failed to get container status \"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468\": rpc error: code = NotFound desc = could not find container \"af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468\": container with ID starting with af3746bcc058f9be6f55adb8c577d800564cbc20a4b14595bd4941433762f468 not found: ID does not exist"
May 26 07:11:43.208021 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.207977    2552 scope.go:117] "RemoveContainer" containerID="f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"
May 26 07:11:43.208177 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.208159    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9"} err="failed to get container status \"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9\": rpc error: code = NotFound desc = could not find container \"f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9\": container with ID starting with f5a1d2504bf8ed2f427a1bf9826f9dc97897f5d1af93ea226cbd5d21a52ba2e9 not found: ID does not exist"
May 26 07:11:43.248345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.248326    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:43.248345 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.248345    2552 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-offline-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:43.248495 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.248353    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:43.248495 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.248361    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:43.248495 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:43.248370    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pggzp\" (UniqueName: \"kubernetes.io/projected/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea-kube-api-access-pggzp\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:11:44.449190 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:44.449159    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" path="/var/lib/kubelet/pods/96cb4ef6-8ffb-4969-ae02-6b09362ea2ea/volumes"
May 26 07:11:58.365772 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:58.365740    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:11:58.367420 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:58.367382    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:11:58.370016 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:58.369998    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:11:58.371808 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:11:58.371788    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:13:28.921487 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921389    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921716    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" containerName="redis"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921727    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" containerName="redis"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921735    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921740    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921750    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c967f542-d17f-45d7-87fe-3313a363e240" containerName="postgres"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921756    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c967f542-d17f-45d7-87fe-3313a363e240" containerName="postgres"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921765    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="feast-apply"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921770    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="feast-apply"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921776    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921781    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921793    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="feast-init"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921799    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="feast-init"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921804    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="offline"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921809    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="offline"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921851    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="online"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921860    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8c4c4ac-6165-49b2-82a2-7b98750023b8" containerName="redis"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921867    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="offline"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921873    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c967f542-d17f-45d7-87fe-3313a363e240" containerName="postgres"
May 26 07:13:28.921965 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.921881    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="96cb4ef6-8ffb-4969-ae02-6b09362ea2ea" containerName="registry"
May 26 07:13:28.924717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.924699    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:13:28.927306 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.927267    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-q8zk8\""
May 26 07:13:28.927463 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.927382    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 26 07:13:28.928016 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.927998    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 26 07:13:28.943681 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.943656    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:13:28.961662 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:28.961636    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr22h\" (UniqueName: \"kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h\") pod \"redis-854544c579-62csp\" (UID: \"aa9f018b-47bf-46b0-9a70-f2446c69dc9c\") " pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:13:29.062537 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.062502    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr22h\" (UniqueName: \"kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h\") pod \"redis-854544c579-62csp\" (UID: \"aa9f018b-47bf-46b0-9a70-f2446c69dc9c\") " pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:13:29.071163 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.071138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr22h\" (UniqueName: \"kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h\") pod \"redis-854544c579-62csp\" (UID: \"aa9f018b-47bf-46b0-9a70-f2446c69dc9c\") " pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:13:29.242730 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.242636    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:13:29.366210 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.366176    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:13:29.369454 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:13:29.369430    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa9f018b_47bf_46b0_9a70_f2446c69dc9c.slice/crio-ef6744a7f333b8d88b7f4ffb01225c761a16325f9d15af7e492ff256e39458a4 WatchSource:0}: Error finding container ef6744a7f333b8d88b7f4ffb01225c761a16325f9d15af7e492ff256e39458a4: Status 404 returned error can't find the container with id ef6744a7f333b8d88b7f4ffb01225c761a16325f9d15af7e492ff256e39458a4
May 26 07:13:29.458890 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.458861    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-62csp" event={"ID":"aa9f018b-47bf-46b0-9a70-f2446c69dc9c","Type":"ContainerStarted","Data":"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"}
May 26 07:13:29.459049 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.458895    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-62csp" event={"ID":"aa9f018b-47bf-46b0-9a70-f2446c69dc9c","Type":"ContainerStarted","Data":"ef6744a7f333b8d88b7f4ffb01225c761a16325f9d15af7e492ff256e39458a4"}
May 26 07:13:29.477778 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:29.477734    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-62csp" podStartSLOduration=1.477721009 podStartE2EDuration="1.477721009s" podCreationTimestamp="2026-05-26 07:13:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:13:29.475850956 +0000 UTC m=+991.696705363" watchObservedRunningTime="2026-05-26 07:13:29.477721009 +0000 UTC m=+991.698575414"
May 26 07:13:34.380238 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.380202    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:13:34.383369 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.383352    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.385816 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.385717    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 26 07:13:34.391374 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.391349    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:13:34.509806 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.509774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.509966 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.509820    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw6n8\" (UniqueName: \"kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.611063 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.611008    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.611238 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.611089    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw6n8\" (UniqueName: \"kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.611484 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.611467    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.619948 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.619925    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw6n8\" (UniqueName: \"kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8\") pod \"postgres-7c7656cc6d-p486v\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.694027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.693926    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:13:34.815599 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:34.815566    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:13:34.818490 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:13:34.818458    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13c91921_50d5_4c65_8e85_bef4d8f8f5b8.slice/crio-7f3c12ef895708b2091f5992c8112442d5f46ad2cd65bdab7501f9703409f85b WatchSource:0}: Error finding container 7f3c12ef895708b2091f5992c8112442d5f46ad2cd65bdab7501f9703409f85b: Status 404 returned error can't find the container with id 7f3c12ef895708b2091f5992c8112442d5f46ad2cd65bdab7501f9703409f85b
May 26 07:13:35.474139 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:35.474099    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" event={"ID":"13c91921-50d5-4c65-8e85-bef4d8f8f5b8","Type":"ContainerStarted","Data":"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"}
May 26 07:13:35.474139 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:35.474140    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" event={"ID":"13c91921-50d5-4c65-8e85-bef4d8f8f5b8","Type":"ContainerStarted","Data":"7f3c12ef895708b2091f5992c8112442d5f46ad2cd65bdab7501f9703409f85b"}
May 26 07:13:35.488969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:35.488886    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" podStartSLOduration=1.48886951 podStartE2EDuration="1.48886951s" podCreationTimestamp="2026-05-26 07:13:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:13:35.488530265 +0000 UTC m=+997.709384671" watchObservedRunningTime="2026-05-26 07:13:35.48886951 +0000 UTC m=+997.709723916"
May 26 07:13:40.524911 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.524882    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:13:40.527276 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.527256    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.529663 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.529636    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 26 07:13:40.529761 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.529657    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-p26n7\""
May 26 07:13:40.529910 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.529891    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 26 07:13:40.530022 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.529891    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 26 07:13:40.537200 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.537175    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:13:40.664112 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.664082    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.664278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.664121    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82j4\" (UniqueName: \"kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.664278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.664145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.664278 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.664233    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.765604 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.765567    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.765782 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.765619    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.765782 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.765671    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.765782 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.765693    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r82j4\" (UniqueName: \"kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.766102 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.766079    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.768153 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.768125    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.768253 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.768153    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.775126 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.775076    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82j4\" (UniqueName: \"kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4\") pod \"feast-credit-scoring-7dfb86576c-sp4rz\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") " pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.837096 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.837063    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:40.963771 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:40.963740    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:13:40.966774 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:13:40.966746    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5287b1_0288_42d6_9cf8_36cff465dcd7.slice/crio-8fcbf4a7f5fd415bd6a71bcf71862a6865d9c3f3d66748265e7046bb8e6593d8 WatchSource:0}: Error finding container 8fcbf4a7f5fd415bd6a71bcf71862a6865d9c3f3d66748265e7046bb8e6593d8: Status 404 returned error can't find the container with id 8fcbf4a7f5fd415bd6a71bcf71862a6865d9c3f3d66748265e7046bb8e6593d8
May 26 07:13:41.491495 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:41.491453    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerStarted","Data":"b4b0ba9b21680f9eccc7f19e7484830299ead94c164b76646951c21297857314"}
May 26 07:13:41.491495 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:41.491499    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerStarted","Data":"8fcbf4a7f5fd415bd6a71bcf71862a6865d9c3f3d66748265e7046bb8e6593d8"}
May 26 07:13:42.496134 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:42.496098    2552 generic.go:358] "Generic (PLEG): container finished" podID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerID="b4b0ba9b21680f9eccc7f19e7484830299ead94c164b76646951c21297857314" exitCode=0
May 26 07:13:42.496134 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:42.496137    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerDied","Data":"b4b0ba9b21680f9eccc7f19e7484830299ead94c164b76646951c21297857314"}
May 26 07:13:43.500239 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:43.500206    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerStarted","Data":"6b36df5b476cbe3c2b471a0ef65add2eaf57dfe6b82a56e18779ff385801bcce"}
May 26 07:13:50.520989 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:50.520953    2552 generic.go:358] "Generic (PLEG): container finished" podID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerID="6b36df5b476cbe3c2b471a0ef65add2eaf57dfe6b82a56e18779ff385801bcce" exitCode=0
May 26 07:13:50.521424 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:50.521019    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerDied","Data":"6b36df5b476cbe3c2b471a0ef65add2eaf57dfe6b82a56e18779ff385801bcce"}
May 26 07:13:51.525880 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:51.525839    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerStarted","Data":"4e11be86d9ff3cdd315ed85c34481cf37cc01e7ad408ebdba29570311fac406d"}
May 26 07:13:51.526249 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:51.525898    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerStarted","Data":"04748d0a1cd783c471e3d89fa15ae7c2d6c867e9f276292a23ecaeeec40d6b60"}
May 26 07:13:51.550158 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:51.550105    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podStartSLOduration=11.550086029 podStartE2EDuration="11.550086029s" podCreationTimestamp="2026-05-26 07:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:13:51.54765125 +0000 UTC m=+1013.768505659" watchObservedRunningTime="2026-05-26 07:13:51.550086029 +0000 UTC m=+1013.770940435"
May 26 07:13:52.838151 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:52.838104    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:52.838151 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:52.838160    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:52.839843 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:52.839814    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
May 26 07:13:52.839969 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:52.839859    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 07:13:55.837741 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:55.837687    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
May 26 07:13:56.425384 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:56.425353    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:56.425814 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:56.425789    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:56.429506 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:56.429455    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:13:58.837922 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:13:58.837868    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
May 26 07:14:00.837863 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:00.837821    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:14:01.838172 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:01.838141    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:14:01.838807 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:01.838787    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:14:06.384014 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.383976    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:14:06.388352 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.388333    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.390931 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.390908    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 26 07:14:06.391043 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.390992    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 07:14:06.391159 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.391140    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 26 07:14:06.391203 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.391168    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-jf79m\""
May 26 07:14:06.398935 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.398916    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:14:06.479572 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.479549    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnht\" (UniqueName: \"kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.479694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.479580    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.479694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.479648    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.479694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.479677    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.580959 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.580929    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.581086 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.580985    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.581086 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.581024    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnht\" (UniqueName: \"kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.581086 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.581051    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.581485 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.581465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.583371 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.583345    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.583475 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.583433    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.589856 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.589834    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnht\" (UniqueName: \"kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht\") pod \"feast-driver-ranking-66cbf44588-k92cg\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") " pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.698188 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.698115    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:06.824824 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:06.824794    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:14:06.827612 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:14:06.827580    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f87c527_7392_420b_96ca_487df3ae793b.slice/crio-f2a89147e4d7f1309a2e731cdfacece54418d973a42747a0a5f81cccdbcb6a2d WatchSource:0}: Error finding container f2a89147e4d7f1309a2e731cdfacece54418d973a42747a0a5f81cccdbcb6a2d: Status 404 returned error can't find the container with id f2a89147e4d7f1309a2e731cdfacece54418d973a42747a0a5f81cccdbcb6a2d
May 26 07:14:07.577211 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:07.577175    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerStarted","Data":"05d61f18087ff1d1a5e03d9253f7860a5bc60b4c6fceb4cb778dc5aa7c4d8532"}
May 26 07:14:07.577211 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:07.577214    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerStarted","Data":"f2a89147e4d7f1309a2e731cdfacece54418d973a42747a0a5f81cccdbcb6a2d"}
May 26 07:14:11.590703 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:11.590625    2552 generic.go:358] "Generic (PLEG): container finished" podID="8f87c527-7392-420b-96ca-487df3ae793b" containerID="05d61f18087ff1d1a5e03d9253f7860a5bc60b4c6fceb4cb778dc5aa7c4d8532" exitCode=0
May 26 07:14:11.591030 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:11.590703    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerDied","Data":"05d61f18087ff1d1a5e03d9253f7860a5bc60b4c6fceb4cb778dc5aa7c4d8532"}
May 26 07:14:12.594803 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:12.594767    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerStarted","Data":"06f5a637d7b4c7b0a73ed081629355480012cbef7f743f1ffd46586469959292"}
May 26 07:14:18.614461 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:18.614430    2552 generic.go:358] "Generic (PLEG): container finished" podID="8f87c527-7392-420b-96ca-487df3ae793b" containerID="06f5a637d7b4c7b0a73ed081629355480012cbef7f743f1ffd46586469959292" exitCode=0
May 26 07:14:18.614807 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:18.614480    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerDied","Data":"06f5a637d7b4c7b0a73ed081629355480012cbef7f743f1ffd46586469959292"}
May 26 07:14:19.619747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:19.619715    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerStarted","Data":"041814affc578ac0ba032dc7924065566858ab5242d8a54d574b2e762c3b2534"}
May 26 07:14:19.620096 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:19.619757    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerStarted","Data":"a1134b5c34bf06c508a0ded8489acebbd01a3949a855f3b65bc6f9efca514b3e"}
May 26 07:14:19.653656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:19.653593    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podStartSLOduration=13.653579394 podStartE2EDuration="13.653579394s" podCreationTimestamp="2026-05-26 07:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:14:19.651703746 +0000 UTC m=+1041.872558155" watchObservedRunningTime="2026-05-26 07:14:19.653579394 +0000 UTC m=+1041.874433799"
May 26 07:14:21.698473 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:21.698438    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:21.699224 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:21.698489    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:21.700100 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:21.700066    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
May 26 07:14:21.700192 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:21.700095    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
May 26 07:14:24.698879 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:24.698825    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
May 26 07:14:24.703842 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:24.703815    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:24.704317 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:24.704296    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:24.706912 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:24.706889    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:26.698629 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:26.698594    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:27.698463 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:27.698418    2552 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
May 26 07:14:30.699587 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:30.699558    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:14:30.700301 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:14:30.700278    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:15:45.182097 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.182052    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:15:45.182688 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.182347    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" podUID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" containerName="manager" containerID="cri-o://7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc" gracePeriod=10
May 26 07:15:45.469811 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.469786    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:15:45.502664 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.502634    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:15:45.502983 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.502931    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry" containerID="cri-o://a1134b5c34bf06c508a0ded8489acebbd01a3949a855f3b65bc6f9efca514b3e" gracePeriod=30
May 26 07:15:45.502983 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.502976    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online" containerID="cri-o://041814affc578ac0ba032dc7924065566858ab5242d8a54d574b2e762c3b2534" gracePeriod=30
May 26 07:15:45.506715 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.506688    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:15:45.507011 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.506982    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry" containerID="cri-o://04748d0a1cd783c471e3d89fa15ae7c2d6c867e9f276292a23ecaeeec40d6b60" gracePeriod=30
May 26 07:15:45.507139 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.507021    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online" containerID="cri-o://4e11be86d9ff3cdd315ed85c34481cf37cc01e7ad408ebdba29570311fac406d" gracePeriod=30
May 26 07:15:45.645859 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.645828    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ttgl\" (UniqueName: \"kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl\") pod \"edb0e48f-03d9-415d-b7a0-1b1963b772bc\" (UID: \"edb0e48f-03d9-415d-b7a0-1b1963b772bc\") "
May 26 07:15:45.647986 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.647955    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl" (OuterVolumeSpecName: "kube-api-access-4ttgl") pod "edb0e48f-03d9-415d-b7a0-1b1963b772bc" (UID: "edb0e48f-03d9-415d-b7a0-1b1963b772bc"). InnerVolumeSpecName "kube-api-access-4ttgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:15:45.746780 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.746690    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ttgl\" (UniqueName: \"kubernetes.io/projected/edb0e48f-03d9-415d-b7a0-1b1963b772bc-kube-api-access-4ttgl\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:15:45.885586 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.885547    2552 generic.go:358] "Generic (PLEG): container finished" podID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" containerID="7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc" exitCode=0
May 26 07:15:45.885794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.885615    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"
May 26 07:15:45.885794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.885640    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" event={"ID":"edb0e48f-03d9-415d-b7a0-1b1963b772bc","Type":"ContainerDied","Data":"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"}
May 26 07:15:45.885794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.885682    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp" event={"ID":"edb0e48f-03d9-415d-b7a0-1b1963b772bc","Type":"ContainerDied","Data":"156b4d8fffdf5dc08a69d27e001ba5f99a9c432e931febc2149ca6cd333bc992"}
May 26 07:15:45.885794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.885703    2552 scope.go:117] "RemoveContainer" containerID="7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"
May 26 07:15:45.896752 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.896731    2552 scope.go:117] "RemoveContainer" containerID="7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"
May 26 07:15:45.897050 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:15:45.897030    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc\": container with ID starting with 7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc not found: ID does not exist" containerID="7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"
May 26 07:15:45.897129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.897059    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc"} err="failed to get container status \"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc\": rpc error: code = NotFound desc = could not find container \"7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc\": container with ID starting with 7c5663fd4cf4adf842b375d550ef4af6d96f8061da2d9fe287b317475699aedc not found: ID does not exist"
May 26 07:15:45.913899 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.913853    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:15:45.916008 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:45.915977    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b846fcd56-bqrkp"]
May 26 07:15:46.426483 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.426434    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 07:15:46.449756 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.449726    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" path="/var/lib/kubelet/pods/edb0e48f-03d9-415d-b7a0-1b1963b772bc/volumes"
May 26 07:15:46.892131 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.892098    2552 generic.go:358] "Generic (PLEG): container finished" podID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerID="4e11be86d9ff3cdd315ed85c34481cf37cc01e7ad408ebdba29570311fac406d" exitCode=0
May 26 07:15:46.892317 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.892179    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerDied","Data":"4e11be86d9ff3cdd315ed85c34481cf37cc01e7ad408ebdba29570311fac406d"}
May 26 07:15:46.894161 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.894138    2552 generic.go:358] "Generic (PLEG): container finished" podID="8f87c527-7392-420b-96ca-487df3ae793b" containerID="041814affc578ac0ba032dc7924065566858ab5242d8a54d574b2e762c3b2534" exitCode=0
May 26 07:15:46.894281 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:46.894188    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerDied","Data":"041814affc578ac0ba032dc7924065566858ab5242d8a54d574b2e762c3b2534"}
May 26 07:15:47.584482 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.584446    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:15:47.584882 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.584647    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" podUID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" containerName="postgres" containerID="cri-o://be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46" gracePeriod=30
May 26 07:15:47.589150 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.589125    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:15:47.589366 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.589337    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-62csp" podUID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" containerName="redis" containerID="cri-o://7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23" gracePeriod=30
May 26 07:15:47.840034 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.839973    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:15:47.865170 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.865143    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:15:47.899197 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.899161    2552 generic.go:358] "Generic (PLEG): container finished" podID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" containerID="be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46" exitCode=0
May 26 07:15:47.899350 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.899206    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v"
May 26 07:15:47.899350 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.899238    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" event={"ID":"13c91921-50d5-4c65-8e85-bef4d8f8f5b8","Type":"ContainerDied","Data":"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"}
May 26 07:15:47.899350 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.899281    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-p486v" event={"ID":"13c91921-50d5-4c65-8e85-bef4d8f8f5b8","Type":"ContainerDied","Data":"7f3c12ef895708b2091f5992c8112442d5f46ad2cd65bdab7501f9703409f85b"}
May 26 07:15:47.899350 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.899302    2552 scope.go:117] "RemoveContainer" containerID="be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"
May 26 07:15:47.900544 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.900519    2552 generic.go:358] "Generic (PLEG): container finished" podID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" containerID="7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23" exitCode=0
May 26 07:15:47.900658 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.900561    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-62csp"
May 26 07:15:47.900658 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.900612    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-62csp" event={"ID":"aa9f018b-47bf-46b0-9a70-f2446c69dc9c","Type":"ContainerDied","Data":"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"}
May 26 07:15:47.900658 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.900635    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-62csp" event={"ID":"aa9f018b-47bf-46b0-9a70-f2446c69dc9c","Type":"ContainerDied","Data":"ef6744a7f333b8d88b7f4ffb01225c761a16325f9d15af7e492ff256e39458a4"}
May 26 07:15:47.907614 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.907593    2552 scope.go:117] "RemoveContainer" containerID="be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"
May 26 07:15:47.907941 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:15:47.907914    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46\": container with ID starting with be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46 not found: ID does not exist" containerID="be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"
May 26 07:15:47.908045 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.907948    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46"} err="failed to get container status \"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46\": rpc error: code = NotFound desc = could not find container \"be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46\": container with ID starting with be1531e93a5f361b4acd83e810c77ce6c0297ca77190484796b9e66c75240e46 not found: ID does not exist"
May 26 07:15:47.908045 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.907975    2552 scope.go:117] "RemoveContainer" containerID="7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"
May 26 07:15:47.915333 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.915312    2552 scope.go:117] "RemoveContainer" containerID="7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"
May 26 07:15:47.915643 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:15:47.915614    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23\": container with ID starting with 7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23 not found: ID does not exist" containerID="7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"
May 26 07:15:47.915717 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.915646    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23"} err="failed to get container status \"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23\": rpc error: code = NotFound desc = could not find container \"7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23\": container with ID starting with 7c3cda21e43f69cc9e6692f3971e6a4945becdd46ff6c0bdcf257fc8c6e4ed23 not found: ID does not exist"
May 26 07:15:47.966697 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.966658    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw6n8\" (UniqueName: \"kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8\") pod \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") "
May 26 07:15:47.966863 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.966731    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata\") pod \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\" (UID: \"13c91921-50d5-4c65-8e85-bef4d8f8f5b8\") "
May 26 07:15:47.966863 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.966763    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr22h\" (UniqueName: \"kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h\") pod \"aa9f018b-47bf-46b0-9a70-f2446c69dc9c\" (UID: \"aa9f018b-47bf-46b0-9a70-f2446c69dc9c\") "
May 26 07:15:47.968853 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.968820    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8" (OuterVolumeSpecName: "kube-api-access-rw6n8") pod "13c91921-50d5-4c65-8e85-bef4d8f8f5b8" (UID: "13c91921-50d5-4c65-8e85-bef4d8f8f5b8"). InnerVolumeSpecName "kube-api-access-rw6n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:15:47.968964 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.968853    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h" (OuterVolumeSpecName: "kube-api-access-vr22h") pod "aa9f018b-47bf-46b0-9a70-f2446c69dc9c" (UID: "aa9f018b-47bf-46b0-9a70-f2446c69dc9c"). InnerVolumeSpecName "kube-api-access-vr22h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:15:47.996662 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:47.996629    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "13c91921-50d5-4c65-8e85-bef4d8f8f5b8" (UID: "13c91921-50d5-4c65-8e85-bef4d8f8f5b8"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:15:48.067955 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.067918    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw6n8\" (UniqueName: \"kubernetes.io/projected/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-kube-api-access-rw6n8\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:15:48.067955 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.067951    2552 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/13c91921-50d5-4c65-8e85-bef4d8f8f5b8-postgresdata\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:15:48.067955 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.067960    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr22h\" (UniqueName: \"kubernetes.io/projected/aa9f018b-47bf-46b0-9a70-f2446c69dc9c-kube-api-access-vr22h\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:15:48.225752 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.225715    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:15:48.231937 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.231901    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-62csp"]
May 26 07:15:48.246483 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.246451    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:15:48.249983 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.249955    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-p486v"]
May 26 07:15:48.450405 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.450353    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" path="/var/lib/kubelet/pods/13c91921-50d5-4c65-8e85-bef4d8f8f5b8/volumes"
May 26 07:15:48.450708 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:48.450694    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" path="/var/lib/kubelet/pods/aa9f018b-47bf-46b0-9a70-f2446c69dc9c/volumes"
May 26 07:15:54.705472 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:54.705384    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
May 26 07:15:56.426489 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:15:56.426442    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 07:16:04.704990 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:04.704952    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
May 26 07:16:06.426419 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:06.426368    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 07:16:06.426846 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:06.426506    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:16:14.704646 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:14.704565    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
May 26 07:16:14.704984 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:14.704682    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:16:15.987704 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:15.987670    2552 generic.go:358] "Generic (PLEG): container finished" podID="8f87c527-7392-420b-96ca-487df3ae793b" containerID="a1134b5c34bf06c508a0ded8489acebbd01a3949a855f3b65bc6f9efca514b3e" exitCode=137
May 26 07:16:15.988095 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:15.987745    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerDied","Data":"a1134b5c34bf06c508a0ded8489acebbd01a3949a855f3b65bc6f9efca514b3e"}
May 26 07:16:15.989542 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:15.989518    2552 generic.go:358] "Generic (PLEG): container finished" podID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerID="04748d0a1cd783c471e3d89fa15ae7c2d6c867e9f276292a23ecaeeec40d6b60" exitCode=137
May 26 07:16:15.989638 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:15.989555    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerDied","Data":"04748d0a1cd783c471e3d89fa15ae7c2d6c867e9f276292a23ecaeeec40d6b60"}
May 26 07:16:16.167584 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.167562    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:16:16.170570 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.170552    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:16:16.297173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297103    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls\") pod \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") "
May 26 07:16:16.297173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297134    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r82j4\" (UniqueName: \"kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4\") pod \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") "
May 26 07:16:16.297173 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297157    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls\") pod \"8f87c527-7392-420b-96ca-487df3ae793b\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") "
May 26 07:16:16.297447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297176    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls\") pod \"8f87c527-7392-420b-96ca-487df3ae793b\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") "
May 26 07:16:16.297447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297200    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls\") pod \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") "
May 26 07:16:16.297447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297217    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data\") pod \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\" (UID: \"5d5287b1-0288-42d6-9cf8-36cff465dcd7\") "
May 26 07:16:16.297447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297250    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data\") pod \"8f87c527-7392-420b-96ca-487df3ae793b\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") "
May 26 07:16:16.297447 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297279    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcnht\" (UniqueName: \"kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht\") pod \"8f87c527-7392-420b-96ca-487df3ae793b\" (UID: \"8f87c527-7392-420b-96ca-487df3ae793b\") "
May 26 07:16:16.297887 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.297853    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data" (OuterVolumeSpecName: "feast-data") pod "8f87c527-7392-420b-96ca-487df3ae793b" (UID: "8f87c527-7392-420b-96ca-487df3ae793b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:16:16.299454 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.299426    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5d5287b1-0288-42d6-9cf8-36cff465dcd7" (UID: "5d5287b1-0288-42d6-9cf8-36cff465dcd7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:16:16.299707 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.299679    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f87c527-7392-420b-96ca-487df3ae793b" (UID: "8f87c527-7392-420b-96ca-487df3ae793b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:16:16.299809 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.299708    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls" (OuterVolumeSpecName: "online-tls") pod "5d5287b1-0288-42d6-9cf8-36cff465dcd7" (UID: "5d5287b1-0288-42d6-9cf8-36cff465dcd7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:16:16.299882 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.299859    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls" (OuterVolumeSpecName: "online-tls") pod "8f87c527-7392-420b-96ca-487df3ae793b" (UID: "8f87c527-7392-420b-96ca-487df3ae793b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 07:16:16.299956 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.299935    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4" (OuterVolumeSpecName: "kube-api-access-r82j4") pod "5d5287b1-0288-42d6-9cf8-36cff465dcd7" (UID: "5d5287b1-0288-42d6-9cf8-36cff465dcd7"). InnerVolumeSpecName "kube-api-access-r82j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:16:16.300023 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.300005    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht" (OuterVolumeSpecName: "kube-api-access-jcnht") pod "8f87c527-7392-420b-96ca-487df3ae793b" (UID: "8f87c527-7392-420b-96ca-487df3ae793b"). InnerVolumeSpecName "kube-api-access-jcnht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:16:16.306731 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.306706    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data" (OuterVolumeSpecName: "feast-data") pod "5d5287b1-0288-42d6-9cf8-36cff465dcd7" (UID: "5d5287b1-0288-42d6-9cf8-36cff465dcd7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:16:16.398340 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398318    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398340 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398338    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-registry-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398347    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5287b1-0288-42d6-9cf8-36cff465dcd7-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398355    2552 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f87c527-7392-420b-96ca-487df3ae793b-feast-data\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398364    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcnht\" (UniqueName: \"kubernetes.io/projected/8f87c527-7392-420b-96ca-487df3ae793b-kube-api-access-jcnht\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398374    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d5287b1-0288-42d6-9cf8-36cff465dcd7-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398383    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r82j4\" (UniqueName: \"kubernetes.io/projected/5d5287b1-0288-42d6-9cf8-36cff465dcd7-kube-api-access-r82j4\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.398477 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.398391    2552 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f87c527-7392-420b-96ca-487df3ae793b-online-tls\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:16:16.994660 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.994631    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"
May 26 07:16:16.994660 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.994646    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg" event={"ID":"8f87c527-7392-420b-96ca-487df3ae793b","Type":"ContainerDied","Data":"f2a89147e4d7f1309a2e731cdfacece54418d973a42747a0a5f81cccdbcb6a2d"}
May 26 07:16:16.995171 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.994696    2552 scope.go:117] "RemoveContainer" containerID="041814affc578ac0ba032dc7924065566858ab5242d8a54d574b2e762c3b2534"
May 26 07:16:16.996975 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.996953    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz" event={"ID":"5d5287b1-0288-42d6-9cf8-36cff465dcd7","Type":"ContainerDied","Data":"8fcbf4a7f5fd415bd6a71bcf71862a6865d9c3f3d66748265e7046bb8e6593d8"}
May 26 07:16:16.997119 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:16.997070    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"
May 26 07:16:17.003219 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.003200    2552 scope.go:117] "RemoveContainer" containerID="a1134b5c34bf06c508a0ded8489acebbd01a3949a855f3b65bc6f9efca514b3e"
May 26 07:16:17.010419 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.010385    2552 scope.go:117] "RemoveContainer" containerID="06f5a637d7b4c7b0a73ed081629355480012cbef7f743f1ffd46586469959292"
May 26 07:16:17.013494 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.013473    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:16:17.017839 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.017819    2552 scope.go:117] "RemoveContainer" containerID="05d61f18087ff1d1a5e03d9253f7860a5bc60b4c6fceb4cb778dc5aa7c4d8532"
May 26 07:16:17.018243 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.018224    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-66cbf44588-k92cg"]
May 26 07:16:17.024730 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.024716    2552 scope.go:117] "RemoveContainer" containerID="4e11be86d9ff3cdd315ed85c34481cf37cc01e7ad408ebdba29570311fac406d"
May 26 07:16:17.029551 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.029531    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:16:17.031466 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.031450    2552 scope.go:117] "RemoveContainer" containerID="04748d0a1cd783c471e3d89fa15ae7c2d6c867e9f276292a23ecaeeec40d6b60"
May 26 07:16:17.034013 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.033992    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7dfb86576c-sp4rz"]
May 26 07:16:17.038377 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.038356    2552 scope.go:117] "RemoveContainer" containerID="6b36df5b476cbe3c2b471a0ef65add2eaf57dfe6b82a56e18779ff385801bcce"
May 26 07:16:17.044586 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:17.044570    2552 scope.go:117] "RemoveContainer" containerID="b4b0ba9b21680f9eccc7f19e7484830299ead94c164b76646951c21297857314"
May 26 07:16:18.449069 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:18.449032    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" path="/var/lib/kubelet/pods/5d5287b1-0288-42d6-9cf8-36cff465dcd7/volumes"
May 26 07:16:18.449560 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:18.449543    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f87c527-7392-420b-96ca-487df3ae793b" path="/var/lib/kubelet/pods/8f87c527-7392-420b-96ca-487df3ae793b/volumes"
May 26 07:16:58.384607 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:58.384577    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:16:58.392861 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:58.392835    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:16:58.393615 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:58.393589    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:16:58.396918 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:16:58.396897    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:21:58.408269 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:21:58.408239    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:21:58.412467 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:21:58.412446    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:21:58.412467 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:21:58.412457    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:21:58.416560 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:21:58.416543    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:26:37.334307 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334225    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xtjw8/must-gather-spzpm"]
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334528    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334539    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334551    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" containerName="postgres"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334557    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" containerName="postgres"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334563    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="feast-init"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334569    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="feast-init"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334574    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="feast-init"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334580    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="feast-init"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334593    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="feast-apply"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334598    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="feast-apply"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334604    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334609    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334616    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" containerName="redis"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334621    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" containerName="redis"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334628    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="feast-apply"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334634    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="feast-apply"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334639    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334644    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334651    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" containerName="manager"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334655    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" containerName="manager"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334663    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334667    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334706    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334715    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="edb0e48f-03d9-415d-b7a0-1b1963b772bc" containerName="manager"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334723    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f87c527-7392-420b-96ca-487df3ae793b" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334731    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="13c91921-50d5-4c65-8e85-bef4d8f8f5b8" containerName="postgres"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334737    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="registry"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334743    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d5287b1-0288-42d6-9cf8-36cff465dcd7" containerName="online"
May 26 07:26:37.334794 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.334749    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa9f018b-47bf-46b0-9a70-f2446c69dc9c" containerName="redis"
May 26 07:26:37.337608 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.337591    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.340006 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.339976    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtjw8\"/\"kube-root-ca.crt\""
May 26 07:26:37.340125 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.339978    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xtjw8\"/\"default-dockercfg-xr285\""
May 26 07:26:37.340621 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.340607    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtjw8\"/\"openshift-service-ca.crt\""
May 26 07:26:37.343606 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.343581    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtjw8/must-gather-spzpm"]
May 26 07:26:37.449874 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.449837    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.449874 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.449885    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncqw\" (UniqueName: \"kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.550252 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.550220    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.550424 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.550262    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dncqw\" (UniqueName: \"kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.551027 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.550999    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.558656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.558630    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncqw\" (UniqueName: \"kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw\") pod \"must-gather-spzpm\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") " pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.655373 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.655344    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:26:37.777328 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.777290    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtjw8/must-gather-spzpm"]
May 26 07:26:37.779982 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:26:37.779949    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbacceb87_f5ea_408d_b8e5_e103f8ada49f.slice/crio-9cbb34ee7703304935b61e8e3dc54baac0734f1a49ee4a56738dca9d1055c2a0 WatchSource:0}: Error finding container 9cbb34ee7703304935b61e8e3dc54baac0734f1a49ee4a56738dca9d1055c2a0: Status 404 returned error can't find the container with id 9cbb34ee7703304935b61e8e3dc54baac0734f1a49ee4a56738dca9d1055c2a0
May 26 07:26:37.781855 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:37.781839    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 07:26:38.689983 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:38.689944    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtjw8/must-gather-spzpm" event={"ID":"bacceb87-f5ea-408d-b8e5-e103f8ada49f","Type":"ContainerStarted","Data":"9cbb34ee7703304935b61e8e3dc54baac0734f1a49ee4a56738dca9d1055c2a0"}
May 26 07:26:44.718123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:44.718032    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtjw8/must-gather-spzpm" event={"ID":"bacceb87-f5ea-408d-b8e5-e103f8ada49f","Type":"ContainerStarted","Data":"dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a"}
May 26 07:26:44.718123 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:44.718083    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtjw8/must-gather-spzpm" event={"ID":"bacceb87-f5ea-408d-b8e5-e103f8ada49f","Type":"ContainerStarted","Data":"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"}
May 26 07:26:44.731828 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:44.731779    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xtjw8/must-gather-spzpm" podStartSLOduration=1.640963689 podStartE2EDuration="7.731766286s" podCreationTimestamp="2026-05-26 07:26:37 +0000 UTC" firstStartedPulling="2026-05-26 07:26:37.781981259 +0000 UTC m=+1780.002835644" lastFinishedPulling="2026-05-26 07:26:43.872783858 +0000 UTC m=+1786.093638241" observedRunningTime="2026-05-26 07:26:44.731057853 +0000 UTC m=+1786.951912268" watchObservedRunningTime="2026-05-26 07:26:44.731766286 +0000 UTC m=+1786.952620691"
May 26 07:26:53.744513 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:53.744476    2552 generic.go:358] "Generic (PLEG): container finished" podID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerID="70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8" exitCode=0
May 26 07:26:53.744940 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:53.744548    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtjw8/must-gather-spzpm" event={"ID":"bacceb87-f5ea-408d-b8e5-e103f8ada49f","Type":"ContainerDied","Data":"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"}
May 26 07:26:53.744940 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:53.744855    2552 scope.go:117] "RemoveContainer" containerID="70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"
May 26 07:26:54.339578 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.339546    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xtjw8_must-gather-spzpm_bacceb87-f5ea-408d-b8e5-e103f8ada49f/gather/0.log"
May 26 07:26:54.810893 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.810866    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gtkbg/must-gather-sdpnw"]
May 26 07:26:54.813163 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.813148    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:54.815694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.815664    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gtkbg\"/\"default-dockercfg-c7p5t\""
May 26 07:26:54.815694 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.815667    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gtkbg\"/\"openshift-service-ca.crt\""
May 26 07:26:54.815997 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.815977    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gtkbg\"/\"kube-root-ca.crt\""
May 26 07:26:54.822946 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.822924    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/must-gather-sdpnw"]
May 26 07:26:54.895879 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.895850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ln7\" (UniqueName: \"kubernetes.io/projected/879b5062-93ec-40fa-b36c-063e0aa0391d-kube-api-access-45ln7\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:54.896016 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.895906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/879b5062-93ec-40fa-b36c-063e0aa0391d-must-gather-output\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:54.996496 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.996462    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/879b5062-93ec-40fa-b36c-063e0aa0391d-must-gather-output\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:54.996636 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.996543    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45ln7\" (UniqueName: \"kubernetes.io/projected/879b5062-93ec-40fa-b36c-063e0aa0391d-kube-api-access-45ln7\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:54.996778 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:54.996760    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/879b5062-93ec-40fa-b36c-063e0aa0391d-must-gather-output\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:55.004144 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:55.004118    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ln7\" (UniqueName: \"kubernetes.io/projected/879b5062-93ec-40fa-b36c-063e0aa0391d-kube-api-access-45ln7\") pod \"must-gather-sdpnw\" (UID: \"879b5062-93ec-40fa-b36c-063e0aa0391d\") " pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:55.122867 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:55.122830    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/must-gather-sdpnw"
May 26 07:26:55.243153 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:55.243119    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/must-gather-sdpnw"]
May 26 07:26:55.245929 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:26:55.245900    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod879b5062_93ec_40fa_b36c_063e0aa0391d.slice/crio-0675fb4190db2be4c741e63a8ae9defa8f6963e8d6ea5d1ebf6f717df951f358 WatchSource:0}: Error finding container 0675fb4190db2be4c741e63a8ae9defa8f6963e8d6ea5d1ebf6f717df951f358: Status 404 returned error can't find the container with id 0675fb4190db2be4c741e63a8ae9defa8f6963e8d6ea5d1ebf6f717df951f358
May 26 07:26:55.752418 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:55.752369    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/must-gather-sdpnw" event={"ID":"879b5062-93ec-40fa-b36c-063e0aa0391d","Type":"ContainerStarted","Data":"0675fb4190db2be4c741e63a8ae9defa8f6963e8d6ea5d1ebf6f717df951f358"}
May 26 07:26:56.759499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:56.758665    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/must-gather-sdpnw" event={"ID":"879b5062-93ec-40fa-b36c-063e0aa0391d","Type":"ContainerStarted","Data":"85a9ffa515a589e16367531389840e2299f784c442fdf34e72c3c098f5fdaa28"}
May 26 07:26:56.759499 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:56.758710    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/must-gather-sdpnw" event={"ID":"879b5062-93ec-40fa-b36c-063e0aa0391d","Type":"ContainerStarted","Data":"3b54577b5a8c546ad0c614257eb7d43e401452d02fc516410e8dc7a765ab89c5"}
May 26 07:26:56.775612 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:56.775567    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gtkbg/must-gather-sdpnw" podStartSLOduration=1.9806291790000001 podStartE2EDuration="2.775548398s" podCreationTimestamp="2026-05-26 07:26:54 +0000 UTC" firstStartedPulling="2026-05-26 07:26:55.24758886 +0000 UTC m=+1797.468443243" lastFinishedPulling="2026-05-26 07:26:56.04250808 +0000 UTC m=+1798.263362462" observedRunningTime="2026-05-26 07:26:56.773363099 +0000 UTC m=+1798.994217506" watchObservedRunningTime="2026-05-26 07:26:56.775548398 +0000 UTC m=+1798.996402803"
May 26 07:26:57.334747 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:57.334718    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w9jkq_d9cd77e4-fc28-4572-89bc-4e2abe3e4ef6/global-pull-secret-syncer/0.log"
May 26 07:26:57.454371 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:57.454341    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9t8jb_65da128f-a9a9-4330-ae51-b544ae698a52/konnectivity-agent/0.log"
May 26 07:26:57.500122 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:57.500092    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-78.ec2.internal_87f4493db5ec011f6b8f45135568252e/haproxy/0.log"
May 26 07:26:58.464964 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:58.464929    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:26:58.470207 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:58.470184    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:26:58.489845 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:58.489813    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:26:58.490494 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:58.490473    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:26:59.658498 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:59.657648    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xtjw8/must-gather-spzpm"]
May 26 07:26:59.658498 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:59.657939    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-xtjw8/must-gather-spzpm" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="copy" containerID="cri-o://dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a" gracePeriod=2
May 26 07:26:59.660549 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:59.660327    2552 status_manager.go:895] "Failed to get status for pod" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" pod="openshift-must-gather-xtjw8/must-gather-spzpm" err="pods \"must-gather-spzpm\" is forbidden: User \"system:node:ip-10-0-133-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xtjw8\": no relationship found between node 'ip-10-0-133-78.ec2.internal' and this object"
May 26 07:26:59.663367 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:26:59.663346    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xtjw8/must-gather-spzpm"]
May 26 07:27:00.017440 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.017318    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xtjw8_must-gather-spzpm_bacceb87-f5ea-408d-b8e5-e103f8ada49f/copy/0.log"
May 26 07:27:00.018297 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.018000    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:27:00.019896 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.019845    2552 status_manager.go:895] "Failed to get status for pod" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" pod="openshift-must-gather-xtjw8/must-gather-spzpm" err="pods \"must-gather-spzpm\" is forbidden: User \"system:node:ip-10-0-133-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xtjw8\": no relationship found between node 'ip-10-0-133-78.ec2.internal' and this object"
May 26 07:27:00.153878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.152934    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dncqw\" (UniqueName: \"kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw\") pod \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") "
May 26 07:27:00.153878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.153014    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output\") pod \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\" (UID: \"bacceb87-f5ea-408d-b8e5-e103f8ada49f\") "
May 26 07:27:00.153878 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.153553    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bacceb87-f5ea-408d-b8e5-e103f8ada49f" (UID: "bacceb87-f5ea-408d-b8e5-e103f8ada49f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 07:27:00.156127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.156096    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw" (OuterVolumeSpecName: "kube-api-access-dncqw") pod "bacceb87-f5ea-408d-b8e5-e103f8ada49f" (UID: "bacceb87-f5ea-408d-b8e5-e103f8ada49f"). InnerVolumeSpecName "kube-api-access-dncqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 07:27:00.254021 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.253925    2552 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bacceb87-f5ea-408d-b8e5-e103f8ada49f-must-gather-output\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:27:00.254021 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.253969    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dncqw\" (UniqueName: \"kubernetes.io/projected/bacceb87-f5ea-408d-b8e5-e103f8ada49f-kube-api-access-dncqw\") on node \"ip-10-0-133-78.ec2.internal\" DevicePath \"\""
May 26 07:27:00.452138 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.452101    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" path="/var/lib/kubelet/pods/bacceb87-f5ea-408d-b8e5-e103f8ada49f/volumes"
May 26 07:27:00.617597 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.617567    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/alertmanager/0.log"
May 26 07:27:00.638040 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.638008    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/config-reloader/0.log"
May 26 07:27:00.658211 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.658159    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/kube-rbac-proxy-web/0.log"
May 26 07:27:00.679959 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.679915    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/kube-rbac-proxy/0.log"
May 26 07:27:00.701040 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.701009    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/kube-rbac-proxy-metric/0.log"
May 26 07:27:00.722589 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.722554    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/prom-label-proxy/0.log"
May 26 07:27:00.743509 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.743480    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3849bccf-7a30-4347-a74b-861163eee976/init-config-reloader/0.log"
May 26 07:27:00.777335 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.777303    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xtjw8_must-gather-spzpm_bacceb87-f5ea-408d-b8e5-e103f8ada49f/copy/0.log"
May 26 07:27:00.777746 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.777712    2552 generic.go:358] "Generic (PLEG): container finished" podID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerID="dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a" exitCode=143
May 26 07:27:00.777862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.777793    2552 scope.go:117] "RemoveContainer" containerID="dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a"
May 26 07:27:00.777925 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.777795    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtjw8/must-gather-spzpm"
May 26 07:27:00.789291 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.789269    2552 scope.go:117] "RemoveContainer" containerID="70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"
May 26 07:27:00.802464 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.802441    2552 scope.go:117] "RemoveContainer" containerID="dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a"
May 26 07:27:00.802824 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:27:00.802752    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a\": container with ID starting with dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a not found: ID does not exist" containerID="dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a"
May 26 07:27:00.802824 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.802788    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a"} err="failed to get container status \"dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a\": rpc error: code = NotFound desc = could not find container \"dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a\": container with ID starting with dd729c6ca31aec374e9450c6dbdc18d5d4f379d9f1e2d0c847e7a50bde69705a not found: ID does not exist"
May 26 07:27:00.802824 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.802816    2552 scope.go:117] "RemoveContainer" containerID="70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"
May 26 07:27:00.803252 ip-10-0-133-78 kubenswrapper[2552]: E0526 07:27:00.803121    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8\": container with ID starting with 70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8 not found: ID does not exist" containerID="70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"
May 26 07:27:00.803252 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.803151    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8"} err="failed to get container status \"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8\": rpc error: code = NotFound desc = could not find container \"70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8\": container with ID starting with 70724d843d64d1ca81914f760c2be76954fb7a2039ca2c227758efdbb3bf0cd8 not found: ID does not exist"
May 26 07:27:00.902285 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:00.902254    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-l9dp5_31d05e54-47cb-4c74-b822-d884a1c43ea2/monitoring-plugin/0.log"
May 26 07:27:01.058539 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.058464    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svms7_33c8477a-dd56-4047-b1ab-1c332ece0811/node-exporter/0.log"
May 26 07:27:01.081089 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.081058    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svms7_33c8477a-dd56-4047-b1ab-1c332ece0811/kube-rbac-proxy/0.log"
May 26 07:27:01.101230 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.101199    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-svms7_33c8477a-dd56-4047-b1ab-1c332ece0811/init-textfile/0.log"
May 26 07:27:01.418256 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.418217    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd5d98d7-r94rn_f5d08d3c-b185-4f80-a0ff-637c0b4e90a8/telemeter-client/0.log"
May 26 07:27:01.436934 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.436903    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd5d98d7-r94rn_f5d08d3c-b185-4f80-a0ff-637c0b4e90a8/reload/0.log"
May 26 07:27:01.458792 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:01.458760    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd5d98d7-r94rn_f5d08d3c-b185-4f80-a0ff-637c0b4e90a8/kube-rbac-proxy/0.log"
May 26 07:27:03.085595 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:03.085566    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/1.log"
May 26 07:27:03.091698 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:03.091664    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lmcnl_cb89c7ef-42ce-4f70-b6d8-71ae862f40b9/console-operator/2.log"
May 26 07:27:03.422696 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:03.422660    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bdc4f9f46-99fct_0d0f2d90-08eb-4f7d-ba3e-b618fd31abdc/console/0.log"
May 26 07:27:03.453643 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:03.453613    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-fz6cw_0ee26d8b-30ca-4d60-99b6-f2eab46b9e2c/download-server/0.log"
May 26 07:27:04.047225 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047189    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"]
May 26 07:27:04.047507 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047494    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="gather"
May 26 07:27:04.047557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047509    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="gather"
May 26 07:27:04.047557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047519    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="copy"
May 26 07:27:04.047557 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047525    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="copy"
May 26 07:27:04.047650 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047598    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="gather"
May 26 07:27:04.047650 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.047609    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="bacceb87-f5ea-408d-b8e5-e103f8ada49f" containerName="copy"
May 26 07:27:04.051689 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.051664    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.061161 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.061139    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"]
May 26 07:27:04.191791 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.191757    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-proc\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.191791 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.191791    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-lib-modules\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.192248 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.191807    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-podres\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.192248 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.191933    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xm6c\" (UniqueName: \"kubernetes.io/projected/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-kube-api-access-8xm6c\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.192248 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.192006    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-sys\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292419 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292366    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-proc\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292419 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292426    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-lib-modules\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292444    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-podres\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292487    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xm6c\" (UniqueName: \"kubernetes.io/projected/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-kube-api-access-8xm6c\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292501    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-proc\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292526    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-sys\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292568    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-sys\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292589    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-lib-modules\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.292713 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.292588    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-podres\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.300554 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.300499    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xm6c\" (UniqueName: \"kubernetes.io/projected/4a8dc0bc-5df4-4645-96a7-75ca3d501db1-kube-api-access-8xm6c\") pod \"perf-node-gather-daemonset-qz487\" (UID: \"4a8dc0bc-5df4-4645-96a7-75ca3d501db1\") " pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.362589 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.362556    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.433029 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.433005    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwdf_45f9bc59-dc37-4a7e-8f57-80687171002b/dns/0.log"
May 26 07:27:04.455793 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.455763    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwdf_45f9bc59-dc37-4a7e-8f57-80687171002b/kube-rbac-proxy/0.log"
May 26 07:27:04.480529 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.480505    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-295qq_6b1ff199-6dc2-4b3a-bb13-bd873600f564/dns-node-resolver/0.log"
May 26 07:27:04.486934 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.486910    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"]
May 26 07:27:04.490628 ip-10-0-133-78 kubenswrapper[2552]: W0526 07:27:04.490594    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a8dc0bc_5df4_4645_96a7_75ca3d501db1.slice/crio-e9006a005bf9d656e5e6a9220eedd5d8bb582ff4c5e904df317ebc632addcc67 WatchSource:0}: Error finding container e9006a005bf9d656e5e6a9220eedd5d8bb582ff4c5e904df317ebc632addcc67: Status 404 returned error can't find the container with id e9006a005bf9d656e5e6a9220eedd5d8bb582ff4c5e904df317ebc632addcc67
May 26 07:27:04.794862 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.794826    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487" event={"ID":"4a8dc0bc-5df4-4645-96a7-75ca3d501db1","Type":"ContainerStarted","Data":"ad3cbec11ea9f73743a09b9fdc240c5aa4dfbfed1d00fb51fa983308bbfdbf9d"}
May 26 07:27:04.795024 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.794867    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487" event={"ID":"4a8dc0bc-5df4-4645-96a7-75ca3d501db1","Type":"ContainerStarted","Data":"e9006a005bf9d656e5e6a9220eedd5d8bb582ff4c5e904df317ebc632addcc67"}
May 26 07:27:04.795024 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.794926    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:04.882205 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.882174    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55784c4fdb-pzzhw_4669bbd7-c56c-438f-a9a2-5ed5f5244c10/registry/0.log"
May 26 07:27:04.938939 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:04.938910    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlbl6_c4293f84-219f-4096-9112-86b361db2d37/node-ca/0.log"
May 26 07:27:05.868359 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:05.868323    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnsp7_01559bcd-c178-493e-b3ed-712f265af495/serve-healthcheck-canary/0.log"
May 26 07:27:06.284588 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:06.284512    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjd4h_64be458e-4094-41e1-be76-6db601002aa2/kube-rbac-proxy/0.log"
May 26 07:27:06.301845 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:06.301818    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjd4h_64be458e-4094-41e1-be76-6db601002aa2/exporter/0.log"
May 26 07:27:06.320656 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:06.320630    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zjd4h_64be458e-4094-41e1-be76-6db601002aa2/extractor/0.log"
May 26 07:27:10.808129 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:10.808099    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487"
May 26 07:27:10.825540 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:10.825495    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gtkbg/perf-node-gather-daemonset-qz487" podStartSLOduration=6.825480245 podStartE2EDuration="6.825480245s" podCreationTimestamp="2026-05-26 07:27:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 07:27:04.810219519 +0000 UTC m=+1807.031073926" watchObservedRunningTime="2026-05-26 07:27:10.825480245 +0000 UTC m=+1813.046334649"
May 26 07:27:11.087639 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.087562    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/kube-multus-additional-cni-plugins/0.log"
May 26 07:27:11.108625 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.108604    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/egress-router-binary-copy/0.log"
May 26 07:27:11.125298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.125271    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/cni-plugins/0.log"
May 26 07:27:11.144256 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.144234    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/bond-cni-plugin/0.log"
May 26 07:27:11.161298 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.161278    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/routeoverride-cni/0.log"
May 26 07:27:11.178206 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.178183    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/whereabouts-cni-bincopy/0.log"
May 26 07:27:11.195190 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.195169    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fzxs6_3416211a-32ce-4924-a1c4-f7a52c7e6494/whereabouts-cni/0.log"
May 26 07:27:11.342127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.342072    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qj4kf_9d8174f3-bc7a-4b5d-9e92-88014c915161/kube-multus/0.log"
May 26 07:27:11.475277 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.475242    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wthnw_2c3534cd-da84-4818-ab24-378f8ebef1fe/network-metrics-daemon/0.log"
May 26 07:27:11.491013 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:11.490974    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wthnw_2c3534cd-da84-4818-ab24-378f8ebef1fe/kube-rbac-proxy/0.log"
May 26 07:27:12.331206 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.331161    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-controller/0.log"
May 26 07:27:12.346752 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.346722    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/0.log"
May 26 07:27:12.358082 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.358049    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovn-acl-logging/1.log"
May 26 07:27:12.377714 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.377681    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/kube-rbac-proxy-node/0.log"
May 26 07:27:12.398127 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.398099    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/kube-rbac-proxy-ovn-metrics/0.log"
May 26 07:27:12.418049 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.418028    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/northd/0.log"
May 26 07:27:12.440596 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.440576    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/nbdb/0.log"
May 26 07:27:12.463456 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.463436    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/sbdb/0.log"
May 26 07:27:12.572164 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:12.572139    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6d6fn_9e808798-a262-4a85-bcf5-98ba8f0abdad/ovnkube-controller/0.log"
May 26 07:27:13.883649 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:13.883626    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-bq4sw_94c4fada-385b-492e-8d9f-370cfcece98f/check-endpoints/0.log"
May 26 07:27:13.945159 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:13.945098    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zgmwn_9e7c1818-785e-45ce-a9a4-b67b9c306172/network-check-target-container/0.log"
May 26 07:27:14.730260 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:14.730237    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tq2pr_9f40c1a0-07af-4b20-80f1-05fd197eaa64/iptables-alerter/0.log"
May 26 07:27:15.333774 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:15.333747    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bqr8g_021f0595-5f2e-41c3-9153-b90de710024d/tuned/0.log"
May 26 07:27:16.766270 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:16.766239    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-hvp6s_ca4634b1-9e26-44c7-9e7f-c52e41ed83d8/cluster-samples-operator/0.log"
May 26 07:27:16.781872 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:16.781850    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-hvp6s_ca4634b1-9e26-44c7-9e7f-c52e41ed83d8/cluster-samples-operator-watch/0.log"
May 26 07:27:17.624637 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:17.624581    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-664k5_ca413db1-14bb-450c-83d2-3dd72ce54e80/service-ca-operator/1.log"
May 26 07:27:17.626207 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:17.626188    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-664k5_ca413db1-14bb-450c-83d2-3dd72ce54e80/service-ca-operator/0.log"
May 26 07:27:18.229816 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:18.229793    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-56z4m_e5a01383-3062-4834-a2a7-f44acf0dc101/csi-driver/0.log"
May 26 07:27:18.248813 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:18.248789    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-56z4m_e5a01383-3062-4834-a2a7-f44acf0dc101/csi-node-driver-registrar/0.log"
May 26 07:27:18.265525 ip-10-0-133-78 kubenswrapper[2552]: I0526 07:27:18.265502    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-56z4m_e5a01383-3062-4834-a2a7-f44acf0dc101/csi-liveness-probe/0.log"