May 28 07:16:51.159660 ip-10-0-130-201 systemd[1]: Starting Kubernetes Kubelet...
May 28 07:16:51.580851 ip-10-0-130-201 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:16:51.580851 ip-10-0-130-201 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 07:16:51.580851 ip-10-0-130-201 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:16:51.580851 ip-10-0-130-201 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 07:16:51.580851 ip-10-0-130-201 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:16:51.581829 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.581736    2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 07:16:51.585768 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585752    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:16:51.585768 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585766    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:16:51.585768 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585770    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585774    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585779    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585782    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585785    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585788    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585791    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585794    2570 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585797    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585800    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585802    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585805    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585809    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585811    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585814    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585816    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585820    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585825    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585828    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:16:51.585856 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585832    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585836    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585840    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585843    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585846    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585850    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585852    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585855    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585858    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585861    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585864    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585866    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585869    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585872    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585875    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585877    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585880    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585882    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585885    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:16:51.586364 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585887    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585890    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585892    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585895    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585898    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585900    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585903    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585907    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585909    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585911    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585914    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585916    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585920    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585922    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585925    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585928    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585930    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585933    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585935    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585938    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:16:51.586847 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585941    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585944    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585946    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585949    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585951    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585954    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585958    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585961    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585963    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585966    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585969    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585971    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585973    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585976    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585978    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585980    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585983    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585985    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585988    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585990    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:16:51.587432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585992    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585995    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.585997    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586000    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586002    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586004    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586401    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586408    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586411    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586414    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586417    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586419    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586422    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586425    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586428    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586431    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586433    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586436    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586439    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586442    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:16:51.587924 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586445    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586447    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586450    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586454    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586457    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586459    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586462    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586464    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586466    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586469    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586471    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586474    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586476    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586479    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586482    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586484    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586487    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586489    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586492    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586495    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:16:51.588451 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586497    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586500    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586503    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586505    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586508    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586510    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586515    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586518    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586521    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586524    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586527    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586530    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586533    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586535    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586537    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586540    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586542    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586545    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586547    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:16:51.588930 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586549    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586552    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586554    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586556    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586559    2570 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586562    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586564    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586567    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586569    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586572    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586574    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586577    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586580    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586582    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586585    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586587    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586590    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586593    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586596    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586598    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:16:51.589432 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586600    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586603    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586606    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586608    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586610    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586613    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586616    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586618    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586620    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586623    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586625    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586627    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.586630    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588449    2570 flags.go:64] FLAG: --address="0.0.0.0"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588460    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588467    2570 flags.go:64] FLAG: --anonymous-auth="true"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588472    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588476    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588480    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588484    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588488    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 07:16:51.589915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588491    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588494    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588498    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588502    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588506    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588509    2570 flags.go:64] FLAG: --cgroup-root=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588512    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588515    2570 flags.go:64] FLAG: --client-ca-file=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588518    2570 flags.go:64] FLAG: --cloud-config=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588520    2570 flags.go:64] FLAG: --cloud-provider="external"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588523    2570 flags.go:64] FLAG: --cluster-dns="[]"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588528    2570 flags.go:64] FLAG: --cluster-domain=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588531    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588534    2570 flags.go:64] FLAG: --config-dir=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588536    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588540    2570 flags.go:64] FLAG: --container-log-max-files="5"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588548    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588552    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588555    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588558    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588561    2570 flags.go:64] FLAG: --contention-profiling="false"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588564    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588567    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588571    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588573    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 07:16:51.590445 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588578    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588581    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588584    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588586    2570 flags.go:64] FLAG: --enable-load-reader="false"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588589    2570 flags.go:64] FLAG: --enable-server="true"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588592    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588597    2570 flags.go:64] FLAG: --event-burst="100"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588600    2570 flags.go:64] FLAG: --event-qps="50"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588603    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588606    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588610    2570 flags.go:64] FLAG: --eviction-hard=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588614    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588617    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588620    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588623    2570 flags.go:64] FLAG: --eviction-soft=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588625    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588628    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588631    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588634    2570 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588637    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588640    2570 flags.go:64] FLAG: --fail-swap-on="true"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588643    2570 flags.go:64] FLAG: --feature-gates=""
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588647    2570 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588650    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588654    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 07:16:51.591042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588659    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588662    2570 flags.go:64] FLAG: --healthz-port="10248"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588665    2570 flags.go:64] FLAG: --help="false"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588668    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-130-201.ec2.internal"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588671    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588674    2570 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588677    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588680    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588686    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588689    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588692    2570 flags.go:64] FLAG: --image-service-endpoint=""
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588695    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588698    2570 flags.go:64] FLAG: --kube-api-burst="100"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588700    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588704    2570 flags.go:64] FLAG: --kube-api-qps="50"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588706    2570 flags.go:64] FLAG: --kube-reserved=""
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588709    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588712    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588715    2570 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588718    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588721    2570 flags.go:64] FLAG: --lock-file=""
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588724    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588727    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588730    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 07:16:51.591657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588735    2570 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588738    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588741    2570 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588744    2570 flags.go:64] FLAG: --logging-format="text"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588747    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588750    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588753    2570 flags.go:64] FLAG: --manifest-url=""
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588756    2570 flags.go:64] FLAG: --manifest-url-header=""
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588760    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588764    2570 flags.go:64] FLAG: --max-open-files="1000000"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588768    2570 flags.go:64] FLAG: --max-pods="110"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588771    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588774    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588777    2570 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588780    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588783    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588787    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588790    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588797    2570 flags.go:64] FLAG: --node-status-max-images="50"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588800    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588803    2570 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588806    2570 flags.go:64] FLAG: --pod-cidr=""
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588809    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 07:16:51.592230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588815    2570 flags.go:64] FLAG: --pod-manifest-path=""
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588818    2570 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588821    2570 flags.go:64] FLAG: --pods-per-core="0"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588825    2570 flags.go:64] FLAG: --port="10250"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588828    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588831    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078242ea1f4f5ecdf"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588834    2570 flags.go:64] FLAG: --qos-reserved=""
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588837    2570 flags.go:64] FLAG: --read-only-port="10255"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588840    2570 flags.go:64] FLAG: --register-node="true"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588843    2570 flags.go:64] FLAG: --register-schedulable="true"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588847    2570 flags.go:64] FLAG: --register-with-taints=""
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588850    2570 flags.go:64] FLAG: --registry-burst="10"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588853    2570 flags.go:64] FLAG: --registry-qps="5"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588856    2570 flags.go:64] FLAG: --reserved-cpus=""
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588860    2570 flags.go:64] FLAG: --reserved-memory=""
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588864    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588867    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588870    2570 flags.go:64] FLAG: --rotate-certificates="false"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588873    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588876    2570 flags.go:64] FLAG: --runonce="false"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588879    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588882    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588885    2570 flags.go:64] FLAG: --seccomp-default="false"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588888    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588891    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588896    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 07:16:51.592803 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588899    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588902    2570 flags.go:64] FLAG: --storage-driver-password="root"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588905    2570 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588908    2570 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588912    2570 flags.go:64] FLAG: --storage-driver-user="root"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588915    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588917    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588920    2570 flags.go:64] FLAG: --system-cgroups=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588923    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588929    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588932    2570 flags.go:64] FLAG: --tls-cert-file=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588935    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588940    2570 flags.go:64] FLAG: --tls-min-version=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588943    2570 flags.go:64] FLAG: --tls-private-key-file=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588946    2570 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588948    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588951    2570 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588954    2570 flags.go:64] FLAG: --v="2"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588958    2570 flags.go:64] FLAG: --version="false"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588962    2570 flags.go:64] FLAG: --vmodule=""
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588966    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.588969    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589065    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589069    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:16:51.593489 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589072    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589075    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589078    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589081    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589084    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589087    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589090    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589094    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589096    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589099    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589102    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589104    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589107    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589109    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589112    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589114    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589117    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589119    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589122    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589125    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:16:51.594089 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589127    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589129    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589132    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589134    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589136    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589139    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589141    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589144    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589146    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589148    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589151    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589153    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589156    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589158    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589161    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589164    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589166    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589169    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589171    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589175    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:16:51.594636 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589187    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589190    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589192    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589195    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589198    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589201    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589203    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589206    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589208    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589212    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589215    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589217    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589220    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589223    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589225    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589227    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589230    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589232    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589235    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:16:51.595126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589239    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589242    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589245    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589248    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589251    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589254    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589256    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589259    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589262    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589268    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589271    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589273    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589280    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589283    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589286    2570 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589288    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589291    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589294    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589297    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589299    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:16:51.595606 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589302    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:16:51.596126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589305    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:16:51.596126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589307    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:16:51.596126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589310    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:16:51.596126 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.589312    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:16:51.596126 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.590205    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:16:51.598472 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.598344    2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 07:16:51.598519 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.598474    2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598525    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598531    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598534    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598537    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598540    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598544    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598546    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:16:51.598552 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598549    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598554    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598560    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598563    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598566    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598569    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598572    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598575    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598578    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598580    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598583    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598587    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598589    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598592    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598595    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598597    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598600    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598602    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598605    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:16:51.598754 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598607    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598610    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598612    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598615    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598617    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598623    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598626    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598629    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598631    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598634    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598636    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598639    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598641    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598644    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598646    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598649    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598652    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598655    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598657    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:16:51.599228 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598660    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598662    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598665    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598667    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598670    2570 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598672    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598674    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598677    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598679    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598682    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598684    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598687    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598689    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598692    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598694    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598697    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598699    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598702    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598705    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598708    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:16:51.599714 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598711    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598713    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598716    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598719    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598722    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598726    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598729    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598732    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598735    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598738    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598740    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598743    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598745    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598748    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598750    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598753    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598755    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598758    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598761    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598763    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:16:51.600206 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598766    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.598771    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598867    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598872    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598875    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598878    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598881    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598883    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598886    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598888    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598891    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598893    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598896    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598900    2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598902    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:16:51.600702 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598905    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598907    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598910    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598912    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598914    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598917    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598920    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598922    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598925    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598927    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598929    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598932    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598934    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598937    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598940    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598943    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598946    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598949    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598951    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:16:51.601067 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598954    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598956    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598958    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598961    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598963    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598966    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598968    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598971    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598974    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598976    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598979    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598982    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598985    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598987    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598990    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598992    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598994    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598997    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.598999    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599002    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:16:51.601567 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599004    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599007    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599009    2570 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599011    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599014    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599016    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599018    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599021    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599024    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599026    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599029    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599031    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599033    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599036    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599038    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599040    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599043    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599045    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599048    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599050    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:16:51.602046 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599053    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599055    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599057    2570 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599060    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599064    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599066    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599069    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599072    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599074    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599077    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599081    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599084    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599087    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:51.599090    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.599095    2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:16:51.602623 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.599970    2570 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 07:16:51.603016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.602510    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 07:16:51.603706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.603695    2570 server.go:1019] "Starting client certificate rotation"
May 28 07:16:51.603812 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.603792    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 07:16:51.606860 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.606811    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 07:16:51.637924 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.637890    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 07:16:51.640087 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.640062    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 07:16:51.655826 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.655802    2570 log.go:25] "Validated CRI v1 runtime API"
May 28 07:16:51.662985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.662966    2570 log.go:25] "Validated CRI v1 image API"
May 28 07:16:51.664400 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.664378    2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 07:16:51.670502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.670477    2570 fs.go:135] Filesystem UUIDs: map[11860127-d72a-4f5c-9a43-e0c373d99166:/dev/nvme0n1p4 617e480f-02bf-41db-bcba-3fc88e5fabb7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 28 07:16:51.670502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.670497    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 07:16:51.676257 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.676136    2570 manager.go:217] Machine: {Timestamp:2026-05-28 07:16:51.675633365 +0000 UTC m=+0.404540099 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094346 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2510f10b68aaf7d2c182b145adae50 SystemUUID:ec2510f1-0b68-aaf7-d2c1-82b145adae50 BootID:32669576-7668-488d-8ffc-04c282ebe667 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:fe:92:f9:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:fe:92:f9:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:95:ca:e9:34:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 07:16:51.677009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.676997    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 07:16:51.677165 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.677152    2570 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 07:16:51.680980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.680945    2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 07:16:51.681123 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.680984    2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 07:16:51.681187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.681133    2570 topology_manager.go:138] "Creating topology manager with none policy"
May 28 07:16:51.681187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.681142    2570 container_manager_linux.go:306] "Creating device plugin manager"
May 28 07:16:51.681187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.681149    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 07:16:51.682987 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.682972    2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 07:16:51.685555 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.685545    2570 state_mem.go:36] "Initialized new in-memory state store"
May 28 07:16:51.685677 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.685667    2570 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 07:16:51.689228 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.689216    2570 kubelet.go:491] "Attempting to sync node with API server"
May 28 07:16:51.689279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.689233    2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 07:16:51.689279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.689251    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 07:16:51.689279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.689261    2570 kubelet.go:397] "Adding apiserver pod source"
May 28 07:16:51.689279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.689270    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 07:16:51.690241 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.690223    2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 07:16:51.690535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.690523    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 07:16:51.690624 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.690545    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 07:16:51.695031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.695015    2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 07:16:51.703068 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.703052    2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 07:16:51.704177 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704163    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 07:16:51.704217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704190    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 07:16:51.704217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704204    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 07:16:51.704217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704214    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704229    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704237    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704243    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704248    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704255    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704261    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 07:16:51.704304 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704269    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 07:16:51.704673 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.704665    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 07:16:51.705679 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.705670    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 07:16:51.705712 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.705682    2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 07:16:51.713780 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.713741    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 07:16:51.713780 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.713767    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 07:16:51.713902 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.713776    2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 07:16:51.715788 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.715775    2570 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 07:16:51.715831 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.715816    2570 server.go:1295] "Started kubelet"
May 28 07:16:51.715951 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.715909    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 07:16:51.716141 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.715926    2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 07:16:51.716212 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.716162    2570 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 07:16:51.716689 ip-10-0-130-201 systemd[1]: Started Kubernetes Kubelet.
May 28 07:16:51.719163 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.719144    2570 server.go:317] "Adding debug handlers to kubelet server"
May 28 07:16:51.719977 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.719960    2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 07:16:51.723292 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.722230    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-201.ec2.internal.18b3a978425935f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-201.ec2.internal,UID:ip-10-0-130-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-201.ec2.internal,},FirstTimestamp:2026-05-28 07:16:51.715790326 +0000 UTC m=+0.444697051,LastTimestamp:2026-05-28 07:16:51.715790326 +0000 UTC m=+0.444697051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-201.ec2.internal,}"
May 28 07:16:51.727465 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.727396    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 07:16:51.727555 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.727471    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 07:16:51.727736 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.727721    2570 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 07:16:51.727989 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.727978    2570 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 07:16:51.728379 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.728358    2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 07:16:51.728722 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.728680    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:51.729273 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.729249    2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 07:16:51.729913 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.729898    2570 reconstruct.go:97] "Volume reconstruction finished"
May 28 07:16:51.729982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.729916    2570 reconciler.go:26] "Reconciler: start to sync state"
May 28 07:16:51.730111 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730097    2570 factory.go:55] Registering systemd factory
May 28 07:16:51.730164 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730117    2570 factory.go:223] Registration of the systemd container factory successfully
May 28 07:16:51.730387 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730366    2570 factory.go:153] Registering CRI-O factory
May 28 07:16:51.730466 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730389    2570 factory.go:223] Registration of the crio container factory successfully
May 28 07:16:51.730620 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730607    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 07:16:51.730667 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730633    2570 factory.go:103] Registering Raw factory
May 28 07:16:51.730667 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.730648    2570 manager.go:1196] Started watching for new ooms in manager
May 28 07:16:51.731104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.731090    2570 manager.go:319] Starting recovery of all containers
May 28 07:16:51.731550 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.731519    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 07:16:51.731550 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.731536    2570 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 07:16:51.742500 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.742479    2570 manager.go:324] Recovery completed
May 28 07:16:51.746832 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.746819    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.748937 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.748903    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.749020 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.748953    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.749020 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.748964    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:51.749509 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.749491    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 07:16:51.749509 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.749506    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 07:16:51.749609 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.749523    2570 state_mem.go:36] "Initialized new in-memory state store"
May 28 07:16:51.753482 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.753465    2570 policy_none.go:49] "None policy: Start"
May 28 07:16:51.753482 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.753484    2570 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 07:16:51.753588 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.753495    2570 state_mem.go:35] "Initializing new in-memory state store"
May 28 07:16:51.758911 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.758840    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-201.ec2.internal.18b3a9784452f62d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-201.ec2.internal,UID:ip-10-0-130-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-201.ec2.internal,},FirstTimestamp:2026-05-28 07:16:51.748935213 +0000 UTC m=+0.477841945,LastTimestamp:2026-05-28 07:16:51.748935213 +0000 UTC m=+0.477841945,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-201.ec2.internal,}"
May 28 07:16:51.768593 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.768573    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crpjc"
May 28 07:16:51.769415 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.769319    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-201.ec2.internal.18b3a978445352a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-201.ec2.internal,UID:ip-10-0-130-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-201.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-201.ec2.internal,},FirstTimestamp:2026-05-28 07:16:51.748958883 +0000 UTC m=+0.477865607,LastTimestamp:2026-05-28 07:16:51.748958883 +0000 UTC m=+0.477865607,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-201.ec2.internal,}"
May 28 07:16:51.781043 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.780975    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-201.ec2.internal.18b3a9784453760a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-201.ec2.internal,UID:ip-10-0-130-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-201.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-201.ec2.internal,},FirstTimestamp:2026-05-28 07:16:51.748967946 +0000 UTC m=+0.477874671,LastTimestamp:2026-05-28 07:16:51.748967946 +0000 UTC m=+0.477874671,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-201.ec2.internal,}"
May 28 07:16:51.781843 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.781819    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crpjc"
May 28 07:16:51.793948 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.793932    2570 manager.go:341] "Starting Device Plugin manager"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.793974    2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.793984    2570 server.go:85] "Starting device plugin registration server"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.794216    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.794228    2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.794375    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.794462    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.794471    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.795571    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 07:16:51.811518 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.795610    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:51.871324 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.871242    2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 07:16:51.872729 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.872710    2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 07:16:51.872814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.872737    2570 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 07:16:51.872814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.872755    2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 07:16:51.872814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.872762    2570 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 07:16:51.872950 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.872882    2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 07:16:51.875616 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.875596    2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:16:51.895247 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.895226    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.896182 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.896168    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.896257 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.896197    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.896257 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.896214    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:51.896257 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.896240    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-201.ec2.internal"
May 28 07:16:51.917022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.916981    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-201.ec2.internal"
May 28 07:16:51.917022 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.917023    2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-201.ec2.internal\": node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:51.965851 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:51.965820    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:51.973898 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.973874    2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"]
May 28 07:16:51.973959 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.973943    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.974887 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.974872    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.974933 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.974901    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.974933 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.974911    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:51.976137 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976125    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.976300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976287    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:51.976374 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976363    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.976836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976820    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.976886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976850    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.976886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976862    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:51.976959 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976820    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.976959 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976921    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.976959 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.976933    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:51.978053 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.978038    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:51.978138 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.978063    2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:16:51.978805 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.978786    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:16:51.978908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.978820    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:16:51.978908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:51.978832    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeHasSufficientPID"
May 28 07:16:52.009201 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.009166    2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-201.ec2.internal\" not found" node="ip-10-0-130-201.ec2.internal"
May 28 07:16:52.014197 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.014175    2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-201.ec2.internal\" not found" node="ip-10-0-130-201.ec2.internal"
May 28 07:16:52.032009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.031977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.032009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.032017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.032190 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.032041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0752c8239f921abcfce7c2a2e59fa864-config\") pod \"kube-apiserver-proxy-ip-10-0-130-201.ec2.internal\" (UID: \"0752c8239f921abcfce7c2a2e59fa864\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.066290 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.066254    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.133186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133099    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.133186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133133    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.133186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133150    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0752c8239f921abcfce7c2a2e59fa864-config\") pod \"kube-apiserver-proxy-ip-10-0-130-201.ec2.internal\" (UID: \"0752c8239f921abcfce7c2a2e59fa864\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.133186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133185    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0752c8239f921abcfce7c2a2e59fa864-config\") pod \"kube-apiserver-proxy-ip-10-0-130-201.ec2.internal\" (UID: \"0752c8239f921abcfce7c2a2e59fa864\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.133439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133193    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.133439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.133208    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcd8027fa6d3b45dcead708c0e21c21-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal\" (UID: \"7fcd8027fa6d3b45dcead708c0e21c21\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.167324 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.167290    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.267576 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.267534    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.311731 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.311701    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.317040 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.316827    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.368592 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.368545    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.469119 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.469032    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.569669 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.569624    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.603806 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.603777    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 07:16:52.604388 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.603931    2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 07:16:52.660263 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.660225    2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:16:52.670558 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:52.670533    2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-201.ec2.internal\" not found"
May 28 07:16:52.724517 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.724281    2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:16:52.728041 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.728026    2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.728108 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.728068    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 07:16:52.745240 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.745213    2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 07:16:52.765442 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.765410    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 07:16:52.766517 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.766502    2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal"
May 28 07:16:52.784484 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.784452    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 07:11:51 +0000 UTC" deadline="2028-01-29 19:35:27.150379426 +0000 UTC"
May 28 07:16:52.784484 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.784479    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14676h18m34.365903241s"
May 28 07:16:52.785848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.785833    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 07:16:52.800044 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.800017    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d29wj"
May 28 07:16:52.811876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.811851    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d29wj"
May 28 07:16:52.827736 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:52.827696    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0752c8239f921abcfce7c2a2e59fa864.slice/crio-c4f693db5576022dad05eeeb2a05dc5627d41e426298e91ef2cdd5c4213d92ea WatchSource:0}: Error finding container c4f693db5576022dad05eeeb2a05dc5627d41e426298e91ef2cdd5c4213d92ea: Status 404 returned error can't find the container with id c4f693db5576022dad05eeeb2a05dc5627d41e426298e91ef2cdd5c4213d92ea
May 28 07:16:52.828106 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:52.828081    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcd8027fa6d3b45dcead708c0e21c21.slice/crio-e1e0751dbc76fa12f1330dbc9473e782ea0c0b7f2fbf716fa71f5b5bbbe84331 WatchSource:0}: Error finding container e1e0751dbc76fa12f1330dbc9473e782ea0c0b7f2fbf716fa71f5b5bbbe84331: Status 404 returned error can't find the container with id e1e0751dbc76fa12f1330dbc9473e782ea0c0b7f2fbf716fa71f5b5bbbe84331
May 28 07:16:52.831458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.831440    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:16:52.875291 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.875237    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal" event={"ID":"0752c8239f921abcfce7c2a2e59fa864","Type":"ContainerStarted","Data":"c4f693db5576022dad05eeeb2a05dc5627d41e426298e91ef2cdd5c4213d92ea"}
May 28 07:16:52.876100 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:52.876078    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal" event={"ID":"7fcd8027fa6d3b45dcead708c0e21c21","Type":"ContainerStarted","Data":"e1e0751dbc76fa12f1330dbc9473e782ea0c0b7f2fbf716fa71f5b5bbbe84331"}
May 28 07:16:53.167722 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.167599    2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:16:53.546549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.546462    2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:16:53.689848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.689821    2570 apiserver.go:52] "Watching apiserver"
May 28 07:16:53.703520 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.703488    2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 07:16:53.706814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.706779    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-s27sk","openshift-multus/network-metrics-daemon-48cgt","openshift-network-operator/iptables-alerter-wj8hg","kube-system/konnectivity-agent-9r4f2","kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6","openshift-image-registry/node-ca-894dv","openshift-multus/multus-jgmst","openshift-network-diagnostics/network-check-target-r8pjx","openshift-ovn-kubernetes/ovnkube-node-2xgnb","openshift-cluster-node-tuning-operator/tuned-wvbd7","openshift-dns/node-resolver-tzs7h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal"]
May 28 07:16:53.711299 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.711217    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.711458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.711369    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.713543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.713385    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.715453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.715425    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.717842 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.717815    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.717958 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.717898    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:16:53.720151 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720014    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.720682 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720658    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 07:16:53.720794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720661    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 07:16:53.720794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720741    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 07:16:53.720794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720749    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 07:16:53.721256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.720998    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 07:16:53.721256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.721086    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qc44k\""
May 28 07:16:53.721256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.721196    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nnzld\""
May 28 07:16:53.722180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.722158    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jgmst"
May 28 07:16:53.724220 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.724194    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 07:16:53.724968 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.724943    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2967\""
May 28 07:16:53.725269 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.725250    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 07:16:53.725636 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.725620    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 07:16:53.728353 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.727028    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:53.728353 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.727101    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:16:53.729687 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.729663    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.732357 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.732113    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 07:16:53.732357 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.732124    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.734380 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.734363    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.734992 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.734976    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 07:16:53.735122 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735003    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 07:16:53.735736 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735717    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 07:16:53.735811 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735748    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 07:16:53.735949 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735935    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 07:16:53.736010 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735995    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 07:16:53.736128 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736102    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 07:16:53.736226 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.735938    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jc2vz\""
May 28 07:16:53.736261 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736253    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 07:16:53.736414 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736397    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 07:16:53.736851 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736605    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r5mrb\""
May 28 07:16:53.736851 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736665    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 07:16:53.736851 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.736694    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cp9ww\""
May 28 07:16:53.741362 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.741344    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w49nf\""
May 28 07:16:53.742953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.742475    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rg69f\""
May 28 07:16:53.742953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.742688    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 07:16:53.742953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.742730    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 07:16:53.742953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.742846    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9vzk\""
May 28 07:16:53.743254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743028    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 07:16:53.743254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743131    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 07:16:53.743254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743155    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 07:16:53.743443 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743276    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 07:16:53.743502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743452    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 07:16:53.743502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743462    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-bin\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-system-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n2fl\" (UniqueName: \"kubernetes.io/projected/9a805528-1688-4c27-b36d-74df2df15f70-kube-api-access-7n2fl\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fchnl\" (UniqueName: \"kubernetes.io/projected/2ebcd8aa-aedb-47a1-a69f-8d475351871f-kube-api-access-fchnl\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-device-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.743816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-script-lib\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e606ad01-92b8-42ca-9767-01079f9685fd-agent-certs\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-netns\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-netns\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.743986    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-node-log\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txnv9\" (UniqueName: \"kubernetes.io/projected/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-kube-api-access-txnv9\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-k8s-cni-cncf-io\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76hd\" (UniqueName: \"kubernetes.io/projected/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kube-api-access-c76hd\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.744139 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e606ad01-92b8-42ca-9767-01079f9685fd-konnectivity-ca\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/216ec96b-2730-4cab-8f3a-2311abc10a8f-iptables-alerter-script\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/216ec96b-2730-4cab-8f3a-2311abc10a8f-host-slash\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-ovn\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-config\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744311    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-slash\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83bca63d-7be2-4448-b3e6-979e625f7582-serviceca\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-os-release\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-os-release\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-kubelet\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-netd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744508    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-env-overrides\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744534    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.744571 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-conf-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/946a664b-2d63-454a-9c6e-b63a906a8b52-ovn-node-metrics-cert\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-cnibin\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-binary-copy\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5vkw\" (UniqueName: \"kubernetes.io/projected/216ec96b-2730-4cab-8f3a-2311abc10a8f-kube-api-access-r5vkw\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-kubelet\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cnibin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-bin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-systemd-units\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjpxb\" (UniqueName: \"kubernetes.io/projected/83bca63d-7be2-4448-b3e6-979e625f7582-kube-api-access-bjpxb\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744857    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-daemon-config\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-multus-certs\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzs5\" (UniqueName: \"kubernetes.io/projected/946a664b-2d63-454a-9c6e-b63a906a8b52-kube-api-access-pmzs5\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-hostroot\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-system-cni-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.744984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-systemd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83bca63d-7be2-4448-b3e6-979e625f7582-host\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cni-binary-copy\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745078    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-socket-dir-parent\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-etc-kubernetes\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-var-lib-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-etc-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-log-socket\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.745882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.745268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-multus\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.813245 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.813146    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:11:52 +0000 UTC" deadline="2028-03-08 20:10:25.877476492 +0000 UTC"
May 28 07:16:53.813245 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.813193    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15612h53m32.064286871s"
May 28 07:16:53.829944 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.829908    2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 07:16:53.846217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846175    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-script-lib\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.846217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846220    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e606ad01-92b8-42ca-9767-01079f9685fd-agent-certs\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846247    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-netns\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846270    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-var-lib-kubelet\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846343    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-kubernetes\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846361    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-netns\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846382    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-registration-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-lib-modules\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.846440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846435    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3587d4-3dec-4896-9b9a-7c51839245e2-hosts-file\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846478    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-netns\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846506    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-node-log\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846524    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-netns\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846534    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846576    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-node-log\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.846628    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846636    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txnv9\" (UniqueName: \"kubernetes.io/projected/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-kube-api-access-txnv9\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846664    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846673    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-k8s-cni-cncf-io\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846718    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-k8s-cni-cncf-io\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.846725    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:54.346672573 +0000 UTC m=+3.075579307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:53.846757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846757    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c76hd\" (UniqueName: \"kubernetes.io/projected/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kube-api-access-c76hd\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2g5\" (UniqueName: \"kubernetes.io/projected/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-kube-api-access-2x2g5\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846807    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e606ad01-92b8-42ca-9767-01079f9685fd-konnectivity-ca\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846829    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846855    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/216ec96b-2730-4cab-8f3a-2311abc10a8f-iptables-alerter-script\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846879    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/216ec96b-2730-4cab-8f3a-2311abc10a8f-host-slash\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846904    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-ovn\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846917    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-script-lib\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846930    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-config\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846950    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.846952    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847019    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847126    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/216ec96b-2730-4cab-8f3a-2311abc10a8f-host-slash\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847137    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-ovn\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847166    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-slash\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847193    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83bca63d-7be2-4448-b3e6-979e625f7582-serviceca\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847213    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-slash\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847219    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-os-release\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-host\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847283    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-os-release\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847307    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-kubelet\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847357    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e606ad01-92b8-42ca-9767-01079f9685fd-konnectivity-ca\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847368    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847392    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-netd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847416    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-env-overrides\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847440    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847447    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-os-release\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847465    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-conf-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847491    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-ovnkube-config\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847503    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847466    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/216ec96b-2730-4cab-8f3a-2311abc10a8f-iptables-alerter-script\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847677    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83bca63d-7be2-4448-b3e6-979e625f7582-serviceca\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847702    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-socket-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847743    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.847862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847780    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-netd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847880    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-tmp\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847899    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/946a664b-2d63-454a-9c6e-b63a906a8b52-ovn-node-metrics-cert\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847918    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-cnibin\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847941    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-binary-copy\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847958    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysconfig\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.847979    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-os-release\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848014    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848018    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-cnibin\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848059    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-conf-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-sys\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848103    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5vkw\" (UniqueName: \"kubernetes.io/projected/216ec96b-2730-4cab-8f3a-2311abc10a8f-kube-api-access-r5vkw\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848079    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-kubelet\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848131    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-kubelet\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848162    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-kubelet\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848202    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cnibin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.848535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848228    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/946a664b-2d63-454a-9c6e-b63a906a8b52-env-overrides\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848228    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-bin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848260    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-bin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-conf\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-systemd\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848321    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cnibin\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848348    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-systemd-units\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848384    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjpxb\" (UniqueName: \"kubernetes.io/projected/83bca63d-7be2-4448-b3e6-979e625f7582-kube-api-access-bjpxb\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848388    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-systemd-units\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848500    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848547    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-daemon-config\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848546    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-binary-copy\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848596    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-multus-certs\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848632    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848659    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzs5\" (UniqueName: \"kubernetes.io/projected/946a664b-2d63-454a-9c6e-b63a906a8b52-kube-api-access-pmzs5\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848668    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-run-multus-certs\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848685    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-hostroot\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.849370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncndl\" (UniqueName: \"kubernetes.io/projected/cd3587d4-3dec-4896-9b9a-7c51839245e2-kube-api-access-ncndl\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848721    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848764    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-system-cni-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a805528-1688-4c27-b36d-74df2df15f70-system-cni-dir\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848917    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848925    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-hostroot\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-tuned\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.848972    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-systemd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849003    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849015    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849030    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83bca63d-7be2-4448-b3e6-979e625f7582-host\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849075    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cni-binary-copy\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849076    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-daemon-config\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849077    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-run-systemd\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849102    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-socket-dir-parent\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849129    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849152    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-multus-socket-dir-parent\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850016 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849152    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-etc-kubernetes\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849180    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83bca63d-7be2-4448-b3e6-979e625f7582-host\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849197    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-etc-kubernetes\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3587d4-3dec-4896-9b9a-7c51839245e2-tmp-dir\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849264    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-var-lib-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849315    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-etc-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849324    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-var-lib-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849381    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-log-socket\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849392    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-etc-openvswitch\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849422    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a805528-1688-4c27-b36d-74df2df15f70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849431    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-log-socket\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849430    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-multus\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849464    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-bin\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849519    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-host-var-lib-cni-multus\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849538    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-system-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849542    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ebcd8aa-aedb-47a1-a69f-8d475351871f-cni-binary-copy\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849559    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/946a664b-2d63-454a-9c6e-b63a906a8b52-host-cni-bin\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849569    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n2fl\" (UniqueName: \"kubernetes.io/projected/9a805528-1688-4c27-b36d-74df2df15f70-kube-api-access-7n2fl\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.850549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849600    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fchnl\" (UniqueName: \"kubernetes.io/projected/2ebcd8aa-aedb-47a1-a69f-8d475351871f-kube-api-access-fchnl\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849615    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ebcd8aa-aedb-47a1-a69f-8d475351871f-system-cni-dir\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849621    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-device-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849651    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849668    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-modprobe-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-run\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849759    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849827    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-sys-fs\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.849878    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-device-dir\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.851081    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/946a664b-2d63-454a-9c6e-b63a906a8b52-ovn-node-metrics-cert\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.851236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.851118    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e606ad01-92b8-42ca-9767-01079f9685fd-agent-certs\") pod \"konnectivity-agent-9r4f2\" (UID: \"e606ad01-92b8-42ca-9767-01079f9685fd\") " pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:53.863690 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.863654    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:16:53.863690 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.863684    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:16:53.863690 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.863695    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:53.863913 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:53.863749    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:54.363735143 +0000 UTC m=+3.092641868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:53.863913 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.863804    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5vkw\" (UniqueName: \"kubernetes.io/projected/216ec96b-2730-4cab-8f3a-2311abc10a8f-kube-api-access-r5vkw\") pod \"iptables-alerter-wj8hg\" (UID: \"216ec96b-2730-4cab-8f3a-2311abc10a8f\") " pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:53.863913 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.863801    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txnv9\" (UniqueName: \"kubernetes.io/projected/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-kube-api-access-txnv9\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:53.864269 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.864245    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76hd\" (UniqueName: \"kubernetes.io/projected/00dc9ab1-c2ae-4b1e-bfc5-8572975b508d-kube-api-access-c76hd\") pod \"aws-ebs-csi-driver-node-s8sm6\" (UID: \"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:53.864675 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.864650    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzs5\" (UniqueName: \"kubernetes.io/projected/946a664b-2d63-454a-9c6e-b63a906a8b52-kube-api-access-pmzs5\") pod \"ovnkube-node-2xgnb\" (UID: \"946a664b-2d63-454a-9c6e-b63a906a8b52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:53.867692 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.867667    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjpxb\" (UniqueName: \"kubernetes.io/projected/83bca63d-7be2-4448-b3e6-979e625f7582-kube-api-access-bjpxb\") pod \"node-ca-894dv\" (UID: \"83bca63d-7be2-4448-b3e6-979e625f7582\") " pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:53.868747 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.868723    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fchnl\" (UniqueName: \"kubernetes.io/projected/2ebcd8aa-aedb-47a1-a69f-8d475351871f-kube-api-access-fchnl\") pod \"multus-jgmst\" (UID: \"2ebcd8aa-aedb-47a1-a69f-8d475351871f\") " pod="openshift-multus/multus-jgmst"
May 28 07:16:53.868915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.868870    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n2fl\" (UniqueName: \"kubernetes.io/projected/9a805528-1688-4c27-b36d-74df2df15f70-kube-api-access-7n2fl\") pod \"multus-additional-cni-plugins-s27sk\" (UID: \"9a805528-1688-4c27-b36d-74df2df15f70\") " pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:53.950926 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.950887    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-modprobe-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.950926 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.950927    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.950948    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-run\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.950979    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-var-lib-kubelet\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951006    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-kubernetes\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951030    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-lib-modules\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951056    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3587d4-3dec-4896-9b9a-7c51839245e2-hosts-file\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951088    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-modprobe-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951150 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951100    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2g5\" (UniqueName: \"kubernetes.io/projected/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-kube-api-access-2x2g5\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951168    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-host\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951206    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-tmp\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951245    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysconfig\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951262    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-sys\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951285    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-conf\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951310    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-systemd\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951361    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncndl\" (UniqueName: \"kubernetes.io/projected/cd3587d4-3dec-4896-9b9a-7c51839245e2-kube-api-access-ncndl\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951387    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-tuned\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951417    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3587d4-3dec-4896-9b9a-7c51839245e2-tmp-dir\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-d\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951556    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-run\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951603    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-var-lib-kubelet\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951646    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-kubernetes\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951745    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3587d4-3dec-4896-9b9a-7c51839245e2-tmp-dir\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951746    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-lib-modules\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951787    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3587d4-3dec-4896-9b9a-7c51839245e2-hosts-file\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:53.951847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951824    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-sys\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.952262 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951862    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-host\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.952262 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951900    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysctl-conf\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.952262 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.951941    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-systemd\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.952262 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.952157    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-sysconfig\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.954568 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.954549    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-tmp\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.954677 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.954602    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-etc-tuned\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.963300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.962780    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2g5\" (UniqueName: \"kubernetes.io/projected/0ebf0e05-2ee0-4e62-baac-7e2598eb6697-kube-api-access-2x2g5\") pod \"tuned-wvbd7\" (UID: \"0ebf0e05-2ee0-4e62-baac-7e2598eb6697\") " pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:53.963750 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:53.963728    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncndl\" (UniqueName: \"kubernetes.io/projected/cd3587d4-3dec-4896-9b9a-7c51839245e2-kube-api-access-ncndl\") pod \"node-resolver-tzs7h\" (UID: \"cd3587d4-3dec-4896-9b9a-7c51839245e2\") " pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:54.025744 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.025705    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6"
May 28 07:16:54.034788 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.034754    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:16:54.044531 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.044496    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-894dv"
May 28 07:16:54.050308 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.050283    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wj8hg"
May 28 07:16:54.057347 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.057310    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s27sk"
May 28 07:16:54.066145 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.066085    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jgmst"
May 28 07:16:54.073843 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.073815    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:16:54.081496 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.081472    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvbd7"
May 28 07:16:54.086126 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.086106    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tzs7h"
May 28 07:16:54.354013 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.353933    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:54.354149 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.354079    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:54.354187 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.354153    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:55.354133054 +0000 UTC m=+4.083039771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:54.454628 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.454585    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:54.454803 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.454781    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:16:54.454861 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.454809    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:16:54.454861 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.454824    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:54.454943 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:54.454896    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:55.454874749 +0000 UTC m=+4.183781466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:54.564738 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.564705    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode606ad01_92b8_42ca_9767_01079f9685fd.slice/crio-c0794b184547a6d337b1a36c3a724c20037370a8f3db940bd2ea8f125f297c4c WatchSource:0}: Error finding container c0794b184547a6d337b1a36c3a724c20037370a8f3db940bd2ea8f125f297c4c: Status 404 returned error can't find the container with id c0794b184547a6d337b1a36c3a724c20037370a8f3db940bd2ea8f125f297c4c
May 28 07:16:54.570253 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.570224    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bca63d_7be2_4448_b3e6_979e625f7582.slice/crio-e3d152051c4e7cd3cd7c140116b1b010a969cecb5335ab57e55c93441030f6ff WatchSource:0}: Error finding container e3d152051c4e7cd3cd7c140116b1b010a969cecb5335ab57e55c93441030f6ff: Status 404 returned error can't find the container with id e3d152051c4e7cd3cd7c140116b1b010a969cecb5335ab57e55c93441030f6ff
May 28 07:16:54.571382 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.571282    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a805528_1688_4c27_b36d_74df2df15f70.slice/crio-c8ca94402856e5d5e40b492bce79a10535757144a694aee4e7d0d45189a99b0d WatchSource:0}: Error finding container c8ca94402856e5d5e40b492bce79a10535757144a694aee4e7d0d45189a99b0d: Status 404 returned error can't find the container with id c8ca94402856e5d5e40b492bce79a10535757144a694aee4e7d0d45189a99b0d
May 28 07:16:54.572078 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.572053    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946a664b_2d63_454a_9c6e_b63a906a8b52.slice/crio-1d9be0d9631a766677191c9fbb1b44f8fc22c51325858ec637d26b90fbdf0790 WatchSource:0}: Error finding container 1d9be0d9631a766677191c9fbb1b44f8fc22c51325858ec637d26b90fbdf0790: Status 404 returned error can't find the container with id 1d9be0d9631a766677191c9fbb1b44f8fc22c51325858ec637d26b90fbdf0790
May 28 07:16:54.574779 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.573050    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216ec96b_2730_4cab_8f3a_2311abc10a8f.slice/crio-d7e9a85ddf6ed911dbce8f0839c427c7a04ae0c1d4b7c7a09c393cdb11af21bd WatchSource:0}: Error finding container d7e9a85ddf6ed911dbce8f0839c427c7a04ae0c1d4b7c7a09c393cdb11af21bd: Status 404 returned error can't find the container with id d7e9a85ddf6ed911dbce8f0839c427c7a04ae0c1d4b7c7a09c393cdb11af21bd
May 28 07:16:54.574779 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.574222    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dc9ab1_c2ae_4b1e_bfc5_8572975b508d.slice/crio-e7e3a437e05458a8608ffebad903e7b2f8e82856bdddc4b3d6544802e31cb2fb WatchSource:0}: Error finding container e7e3a437e05458a8608ffebad903e7b2f8e82856bdddc4b3d6544802e31cb2fb: Status 404 returned error can't find the container with id e7e3a437e05458a8608ffebad903e7b2f8e82856bdddc4b3d6544802e31cb2fb
May 28 07:16:54.575151 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.575012    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebcd8aa_aedb_47a1_a69f_8d475351871f.slice/crio-235e61a026add4af65132a03a62668b91b4a4c684ee14e3488a39e3536a7b2f6 WatchSource:0}: Error finding container 235e61a026add4af65132a03a62668b91b4a4c684ee14e3488a39e3536a7b2f6: Status 404 returned error can't find the container with id 235e61a026add4af65132a03a62668b91b4a4c684ee14e3488a39e3536a7b2f6
May 28 07:16:54.577294 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.577264    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3587d4_3dec_4896_9b9a_7c51839245e2.slice/crio-3f2a844b39e44d00eda5b4c33810c4cbfa1f007baa30ac78b401abafe083a62e WatchSource:0}: Error finding container 3f2a844b39e44d00eda5b4c33810c4cbfa1f007baa30ac78b401abafe083a62e: Status 404 returned error can't find the container with id 3f2a844b39e44d00eda5b4c33810c4cbfa1f007baa30ac78b401abafe083a62e
May 28 07:16:54.578843 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:16:54.578709    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebf0e05_2ee0_4e62_baac_7e2598eb6697.slice/crio-2f4486faac9bdc832994ca779770b7907b8254a017771268223c4ce32754be4f WatchSource:0}: Error finding container 2f4486faac9bdc832994ca779770b7907b8254a017771268223c4ce32754be4f: Status 404 returned error can't find the container with id 2f4486faac9bdc832994ca779770b7907b8254a017771268223c4ce32754be4f
May 28 07:16:54.813994 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.813953    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:11:52 +0000 UTC" deadline="2027-12-19 10:56:03.41203044 +0000 UTC"
May 28 07:16:54.813994 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.813989    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13683h39m8.598044967s"
May 28 07:16:54.878730 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.878690    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerStarted","Data":"c8ca94402856e5d5e40b492bce79a10535757144a694aee4e7d0d45189a99b0d"}
May 28 07:16:54.879665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.879641    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-894dv" event={"ID":"83bca63d-7be2-4448-b3e6-979e625f7582","Type":"ContainerStarted","Data":"e3d152051c4e7cd3cd7c140116b1b010a969cecb5335ab57e55c93441030f6ff"}
May 28 07:16:54.880572 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.880548    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9r4f2" event={"ID":"e606ad01-92b8-42ca-9767-01079f9685fd","Type":"ContainerStarted","Data":"c0794b184547a6d337b1a36c3a724c20037370a8f3db940bd2ea8f125f297c4c"}
May 28 07:16:54.883086 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.883063    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvbd7" event={"ID":"0ebf0e05-2ee0-4e62-baac-7e2598eb6697","Type":"ContainerStarted","Data":"2f4486faac9bdc832994ca779770b7907b8254a017771268223c4ce32754be4f"}
May 28 07:16:54.884507 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.884475    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tzs7h" event={"ID":"cd3587d4-3dec-4896-9b9a-7c51839245e2","Type":"ContainerStarted","Data":"3f2a844b39e44d00eda5b4c33810c4cbfa1f007baa30ac78b401abafe083a62e"}
May 28 07:16:54.885884 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.885841    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6" event={"ID":"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d","Type":"ContainerStarted","Data":"e7e3a437e05458a8608ffebad903e7b2f8e82856bdddc4b3d6544802e31cb2fb"}
May 28 07:16:54.886983 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.886956    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wj8hg" event={"ID":"216ec96b-2730-4cab-8f3a-2311abc10a8f","Type":"ContainerStarted","Data":"d7e9a85ddf6ed911dbce8f0839c427c7a04ae0c1d4b7c7a09c393cdb11af21bd"}
May 28 07:16:54.888255 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.888234    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"1d9be0d9631a766677191c9fbb1b44f8fc22c51325858ec637d26b90fbdf0790"}
May 28 07:16:54.889591 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.889569    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal" event={"ID":"0752c8239f921abcfce7c2a2e59fa864","Type":"ContainerStarted","Data":"bcdb96684265498b0363efff6f5762d0e121b6ded462f4e1abd604c08e69e40e"}
May 28 07:16:54.890613 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.890591    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jgmst" event={"ID":"2ebcd8aa-aedb-47a1-a69f-8d475351871f","Type":"ContainerStarted","Data":"235e61a026add4af65132a03a62668b91b4a4c684ee14e3488a39e3536a7b2f6"}
May 28 07:16:54.903190 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:54.903149    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-201.ec2.internal" podStartSLOduration=2.903135048 podStartE2EDuration="2.903135048s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:16:54.903032511 +0000 UTC m=+3.631939245" watchObservedRunningTime="2026-05-28 07:16:54.903135048 +0000 UTC m=+3.632041782"
May 28 07:16:55.360612 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.360572    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:55.360806 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.360741    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:55.360871 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.360818    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:57.360796438 +0000 UTC m=+6.089703164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:55.461737 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.461696    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:55.461893 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.461859    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:16:55.461893 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.461878    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:16:55.461893 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.461891    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:55.461993 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.461949    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:16:57.461930278 +0000 UTC m=+6.190836998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:55.873528 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.873493    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:55.874000 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.873543    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:55.874000 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.873645    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:16:55.874000 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:55.873791    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:16:55.918824 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.918785    2570 generic.go:358] "Generic (PLEG): container finished" podID="7fcd8027fa6d3b45dcead708c0e21c21" containerID="9b20a3d54ab139d3562c7261b832e62bfb09ffab40992a708d1763ded584e84d" exitCode=0
May 28 07:16:55.919008 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:55.918990    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal" event={"ID":"7fcd8027fa6d3b45dcead708c0e21c21","Type":"ContainerDied","Data":"9b20a3d54ab139d3562c7261b832e62bfb09ffab40992a708d1763ded584e84d"}
May 28 07:16:56.941224 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:56.941183    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal" event={"ID":"7fcd8027fa6d3b45dcead708c0e21c21","Type":"ContainerStarted","Data":"a6dd22c933aa210588fd152458888a3f657044b91a704d49a0356c8091830aba"}
May 28 07:16:56.957809 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:56.957749    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-201.ec2.internal" podStartSLOduration=4.957726422 podStartE2EDuration="4.957726422s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:16:56.956950954 +0000 UTC m=+5.685857686" watchObservedRunningTime="2026-05-28 07:16:56.957726422 +0000 UTC m=+5.686633159"
May 28 07:16:57.377743 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:57.377701    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:57.377945 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.377898    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:57.378002 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.377965    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:01.377948681 +0000 UTC m=+10.106855405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:16:57.478727 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:57.478526    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:57.478727 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.478711    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:16:57.478727 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.478731    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:16:57.479011 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.478745    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:57.479011 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.478805    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:01.47878677 +0000 UTC m=+10.207693488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:16:57.874187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:57.874150    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:57.874417 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.874292    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:16:57.874837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:57.874814    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:57.874946 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:57.874924    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:16:59.873787 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:59.873742    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:16:59.873787 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:16:59.873778    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:16:59.874260 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:59.873901    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:16:59.874260 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:16:59.874094    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:01.416765 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:01.416720    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:01.417260 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.416925    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:01.417260 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.416994    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:09.416974539 +0000 UTC m=+18.145881258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:01.518070 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:01.518019    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:01.518254 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.518206    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:17:01.518254 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.518230    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:17:01.518254 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.518245    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:01.518419 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.518314    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:09.518294413 +0000 UTC m=+18.247201143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:01.874956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:01.874698    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:01.875122 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.875057    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:01.875657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:01.875626    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:01.875789 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:01.875724    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:03.157172 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.157119    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wdf7z"]
May 28 07:17:03.163272 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.163244    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.163446 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.163357    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:03.234097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.234053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.234279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.234107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-kubelet-config\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.234279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.234146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-dbus\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334645 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.334608    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-dbus\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.334681    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.334710    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-kubelet-config\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.334796    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-kubelet-config\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.334841    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bef55471-f8e6-4583-9731-ff4fa58fecb3-dbus\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.334999 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.334851    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:03.334999 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.334939    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:03.834917631 +0000 UTC m=+12.563824346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:03.838205 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.838163    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:03.838473 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.838394    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:03.838473 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.838462    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:04.838441428 +0000 UTC m=+13.567348143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:03.873920 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.873883    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:03.874109 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.874035    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:03.874522 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:03.874490    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:03.874665 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:03.874592    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:04.845114 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:04.845068    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:04.845517 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:04.845230    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:04.845517 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:04.845289    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:06.845275837 +0000 UTC m=+15.574182550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:04.873431 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:04.873399    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:04.873597 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:04.873507    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:05.873582 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:05.873540    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:05.873582 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:05.873582    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:05.874144 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:05.873670    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:05.874144 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:05.873811    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:06.861864 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:06.861816    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:06.862034 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:06.862012    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:06.862111 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:06.862098    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:10.862076297 +0000 UTC m=+19.590983013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:06.873103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:06.873070    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:06.873294 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:06.873208    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:07.873461 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:07.873423    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:07.873920 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:07.873443    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:07.873920 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:07.873569    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:07.873920 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:07.873618    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:08.873179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:08.873088    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:08.873371 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:08.873232    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:09.482898 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:09.482852    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:09.483350 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.483029    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:09.483350 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.483108    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:25.483086271 +0000 UTC m=+34.211992983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:09.583553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:09.583515    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:09.583716 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.583665    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:17:09.583716 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.583682    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:17:09.583716 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.583694    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:09.583884 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.583754    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:25.583740128 +0000 UTC m=+34.312646840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:09.873494 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:09.873455    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:09.873653 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:09.873512    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:09.873653 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.873590    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:09.873782 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:09.873717    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:10.873283 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:10.873246    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:10.873678 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:10.873403    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:10.892623 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:10.892588    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:10.892793 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:10.892747    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:10.892847 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:10.892805    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:18.892790939 +0000 UTC m=+27.621697651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:11.874296 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:11.874255    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:11.874794 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:11.874386    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:11.874794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:11.874439    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:11.874794 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:11.874518    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:12.873873 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:12.873831    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:12.874063 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:12.873943    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:13.873223 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.873189    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:13.873952 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.873227    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:13.873952 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:13.873325    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:13.873952 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:13.873432    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:13.980397 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.980359    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jgmst" event={"ID":"2ebcd8aa-aedb-47a1-a69f-8d475351871f","Type":"ContainerStarted","Data":"b468f8b665d66298ee72aa593fd679e3a6cdb6dc69b6df13b61de012847015bb"}
May 28 07:17:13.982671 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.982626    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="fc9f7fe3c56179f534fdeff19fdbf4f4e56cf4c4612f1a2c91b39b1701e1a788" exitCode=0
May 28 07:17:13.982798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.982729    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"fc9f7fe3c56179f534fdeff19fdbf4f4e56cf4c4612f1a2c91b39b1701e1a788"}
May 28 07:17:13.985309 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.985282    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-894dv" event={"ID":"83bca63d-7be2-4448-b3e6-979e625f7582","Type":"ContainerStarted","Data":"d36dd3b70647df7f13f0079d02e6c114cad713ac6be90bc98795c7d060414d66"}
May 28 07:17:13.986976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.986892    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9r4f2" event={"ID":"e606ad01-92b8-42ca-9767-01079f9685fd","Type":"ContainerStarted","Data":"74cdaf68308df85a4cb22f2dccd3a6b7a61bcca205969d3524950666e17075b8"}
May 28 07:17:13.988719 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.988691    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvbd7" event={"ID":"0ebf0e05-2ee0-4e62-baac-7e2598eb6697","Type":"ContainerStarted","Data":"6b054310d98a4bca2bfb8421237d933a22c6d5d2e4c1f6986baa49ea1dc6fe94"}
May 28 07:17:13.990792 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.990585    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tzs7h" event={"ID":"cd3587d4-3dec-4896-9b9a-7c51839245e2","Type":"ContainerStarted","Data":"248f8d948908643c844d9668df2ba9a45bee118e050d4394ad61551eb76a7c90"}
May 28 07:17:13.992561 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.992534    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6" event={"ID":"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d","Type":"ContainerStarted","Data":"889ad1562302546ef26f1bcc29a11c1d80f0bd15eee86444e0d8ec4477da7e8f"}
May 28 07:17:13.995462 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995442    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:17:13.995810 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995787    2570 generic.go:358] "Generic (PLEG): container finished" podID="946a664b-2d63-454a-9c6e-b63a906a8b52" containerID="9fa395f2c3f27a12cb9cda700c5dcab799d2fea43fb34212db936f08b37c0dd6" exitCode=1
May 28 07:17:13.995917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995824    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"f775b0433db0d13660ab6f287d31b336a582b4d1e59b9e6d9fbc36ee7b3debda"}
May 28 07:17:13.995917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995861    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"d7fd04bdbb04e68015351a63467e8dd79a63f7fda307d284965140c032ff9999"}
May 28 07:17:13.995917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995874    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"24e3154d7ba664f223491e2776c7995d3b4385e48c34f04b64efd31aec3b9777"}
May 28 07:17:13.995917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995886    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerDied","Data":"9fa395f2c3f27a12cb9cda700c5dcab799d2fea43fb34212db936f08b37c0dd6"}
May 28 07:17:13.995917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.995903    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"552e03f06413bbb20d627c024caf4056bd408af6ac8b1189bf563ae0554eb0d3"}
May 28 07:17:13.999250 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:13.999215    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jgmst" podStartSLOduration=3.421465579 podStartE2EDuration="21.999202997s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.603000769 +0000 UTC m=+3.331907481" lastFinishedPulling="2026-05-28 07:17:13.180738168 +0000 UTC m=+21.909644899" observedRunningTime="2026-05-28 07:17:13.998878603 +0000 UTC m=+22.727785341" watchObservedRunningTime="2026-05-28 07:17:13.999202997 +0000 UTC m=+22.728109732"
May 28 07:17:14.017098 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.017029    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wvbd7" podStartSLOduration=3.478436783 podStartE2EDuration="22.017009913s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.60296086 +0000 UTC m=+3.331867576" lastFinishedPulling="2026-05-28 07:17:13.141533979 +0000 UTC m=+21.870440706" observedRunningTime="2026-05-28 07:17:14.016505776 +0000 UTC m=+22.745412503" watchObservedRunningTime="2026-05-28 07:17:14.017009913 +0000 UTC m=+22.745916650"
May 28 07:17:14.030835 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.030791    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9r4f2" podStartSLOduration=4.459487804 podStartE2EDuration="23.030777051s" podCreationTimestamp="2026-05-28 07:16:51 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.566695969 +0000 UTC m=+3.295602682" lastFinishedPulling="2026-05-28 07:17:13.137985212 +0000 UTC m=+21.866891929" observedRunningTime="2026-05-28 07:17:14.030320316 +0000 UTC m=+22.759227050" watchObservedRunningTime="2026-05-28 07:17:14.030777051 +0000 UTC m=+22.759683784"
May 28 07:17:14.076544 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.076490    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tzs7h" podStartSLOduration=3.589319134 podStartE2EDuration="22.076470102s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.602945643 +0000 UTC m=+3.331852360" lastFinishedPulling="2026-05-28 07:17:13.090096612 +0000 UTC m=+21.819003328" observedRunningTime="2026-05-28 07:17:14.076076587 +0000 UTC m=+22.804983321" watchObservedRunningTime="2026-05-28 07:17:14.076470102 +0000 UTC m=+22.805376838"
May 28 07:17:14.092889 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.092826    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-894dv" podStartSLOduration=3.57539465 podStartE2EDuration="22.092809733s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.572679501 +0000 UTC m=+3.301586213" lastFinishedPulling="2026-05-28 07:17:13.090094565 +0000 UTC m=+21.819001296" observedRunningTime="2026-05-28 07:17:14.092236002 +0000 UTC m=+22.821142736" watchObservedRunningTime="2026-05-28 07:17:14.092809733 +0000 UTC m=+22.821716467"
May 28 07:17:14.599584 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.599548    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 07:17:14.809876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.809775    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T07:17:14.599577561Z","UUID":"3b0a567e-cfe7-45f6-9bfb-e609ddf34055","Handler":null,"Name":"","Endpoint":""}
May 28 07:17:14.813160 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.813133    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 07:17:14.813301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.813168    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 07:17:14.873249 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:14.873211    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:14.873820 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:14.873346    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:15.000173 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:15.000129    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6" event={"ID":"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d","Type":"ContainerStarted","Data":"60ae0b9b197d6ff03afb61cddd6d82b61f60d48af9d97a1c68702682faad2880"}
May 28 07:17:15.002865 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:15.002838    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:17:15.003283 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:15.003223    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"1334b54ff6bce96834a6be2cc708b447502a62d18c8cab5d5e8417e235abcc90"}
May 28 07:17:15.873408 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:15.873378    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:15.873945 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:15.873515    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:15.873945 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:15.873563    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:15.873945 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:15.873687    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:16.007301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:16.007257    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6" event={"ID":"00dc9ab1-c2ae-4b1e-bfc5-8572975b508d","Type":"ContainerStarted","Data":"41b8adb2f3f3b47906bc4102e727a8b9e760c9378ac90b805f5d28dd4f9c5b85"}
May 28 07:17:16.009518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:16.009489    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wj8hg" event={"ID":"216ec96b-2730-4cab-8f3a-2311abc10a8f","Type":"ContainerStarted","Data":"61b9874fa6481b73e86daf1bb7679f8f62317418bba13b42c901676a29099224"}
May 28 07:17:16.027513 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:16.027457    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8sm6" podStartSLOduration=3.778682377 podStartE2EDuration="25.027440942s" podCreationTimestamp="2026-05-28 07:16:51 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.576437289 +0000 UTC m=+3.305344018" lastFinishedPulling="2026-05-28 07:17:15.825195857 +0000 UTC m=+24.554102583" observedRunningTime="2026-05-28 07:17:16.027003888 +0000 UTC m=+24.755910623" watchObservedRunningTime="2026-05-28 07:17:16.027440942 +0000 UTC m=+24.756347669"
May 28 07:17:16.041587 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:16.041530    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wj8hg" podStartSLOduration=5.479464909 podStartE2EDuration="24.041512474s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.575954241 +0000 UTC m=+3.304860967" lastFinishedPulling="2026-05-28 07:17:13.138001812 +0000 UTC m=+21.866908532" observedRunningTime="2026-05-28 07:17:16.040980273 +0000 UTC m=+24.769887007" watchObservedRunningTime="2026-05-28 07:17:16.041512474 +0000 UTC m=+24.770419208"
May 28 07:17:16.873941 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:16.873905    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:16.874552 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:16.874041    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:17.016001 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:17.015971    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:17:17.016403 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:17.016368    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"98ae0b3676c0e96381f0ed7107b0ac62f0594bbba83698b60017a03e9a9921e4"}
May 28 07:17:17.874013 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:17.873970    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:17.874665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:17.873974    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:17.874665 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:17.874116    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:17.874665 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:17.874218    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:18.217208 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:18.217129    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:17:18.217973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:18.217950    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:17:18.873493 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:18.873146    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:18.873493 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:18.873282    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:18.949984 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:18.949907    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:18.950419 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:18.950057    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:17:18.950419 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:18.950132    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret podName:bef55471-f8e6-4583-9731-ff4fa58fecb3 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:34.950114935 +0000 UTC m=+43.679021647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret") pod "global-pull-secret-syncer-wdf7z" (UID: "bef55471-f8e6-4583-9731-ff4fa58fecb3") : object "kube-system"/"original-pull-secret" not registered
May 28 07:17:19.022140 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.022099    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerStarted","Data":"95939e907d6396c6cd983e9136e595cf4b412a21580befa6e175016bfe4cb5d7"}
May 28 07:17:19.025352 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.025311    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:17:19.025676 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.025653    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"48c2e1d3e82f006ebf867fa3f2a2bf40291c559e4373531deb58f0af1413c099"}
May 28 07:17:19.026075 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026050    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:17:19.026233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026088    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:19.026233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026101    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:19.026233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026112    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:19.026366 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026247    2570 scope.go:117] "RemoveContainer" containerID="9fa395f2c3f27a12cb9cda700c5dcab799d2fea43fb34212db936f08b37c0dd6"
May 28 07:17:19.026751 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.026732    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9r4f2"
May 28 07:17:19.042975 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.042954    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:19.043085 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.043018    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:19.873791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.873680    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:19.873980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:19.873694    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:19.873980 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:19.873837    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:19.873980 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:19.873930    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:20.031713 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.031682    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:17:20.032120 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.032031    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" event={"ID":"946a664b-2d63-454a-9c6e-b63a906a8b52","Type":"ContainerStarted","Data":"4b3b1fefd802ab3994e01ac4d806c639e0724e22d6be4591c4c136d2a57eb7ae"}
May 28 07:17:20.033704 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.033672    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="95939e907d6396c6cd983e9136e595cf4b412a21580befa6e175016bfe4cb5d7" exitCode=0
May 28 07:17:20.033848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.033755    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"95939e907d6396c6cd983e9136e595cf4b412a21580befa6e175016bfe4cb5d7"}
May 28 07:17:20.057948 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.057891    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb" podStartSLOduration=9.11995308 podStartE2EDuration="28.057877681s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.575975679 +0000 UTC m=+3.304882395" lastFinishedPulling="2026-05-28 07:17:13.51390027 +0000 UTC m=+22.242806996" observedRunningTime="2026-05-28 07:17:20.056438235 +0000 UTC m=+28.785344970" watchObservedRunningTime="2026-05-28 07:17:20.057877681 +0000 UTC m=+28.786784414"
May 28 07:17:20.609264 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.609228    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdf7z"]
May 28 07:17:20.609465 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.609390    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:20.609524 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:20.609478    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:20.612204 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.612175    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8pjx"]
May 28 07:17:20.612350 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.612271    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:20.612401 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:20.612370    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:20.613108 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.613081    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48cgt"]
May 28 07:17:20.613229 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:20.613170    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:20.613277 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:20.613253    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:21.874254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:21.874224    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:21.874867 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:21.874310    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:22.038793 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:22.038756    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="39de6951759e4816f6acce5384e31867806369d8ea7ec2c88192b776259879c1" exitCode=0
May 28 07:17:22.038976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:22.038826    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"39de6951759e4816f6acce5384e31867806369d8ea7ec2c88192b776259879c1"}
May 28 07:17:22.874088 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:22.874045    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:22.874268 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:22.874183    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:22.874268 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:22.874251    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:22.874758 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:22.874373    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:23.873967 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:23.873925    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:23.874152 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:23.874045    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:24.045599 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:24.045557    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="cb81fca6c1dc09b38b6b3dc8d63cf1cccaa7789c02cc6f4634e28f23cb0f7f6c" exitCode=0
May 28 07:17:24.045992 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:24.045606    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"cb81fca6c1dc09b38b6b3dc8d63cf1cccaa7789c02cc6f4634e28f23cb0f7f6c"}
May 28 07:17:24.873650 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:24.873436    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:24.873815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:24.873473    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:24.873815 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:24.873767    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:24.873815 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:24.873794    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:25.495227 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:25.495182    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:25.495670 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.495363    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:25.495670 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.495435    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:57.495417283 +0000 UTC m=+66.224323998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:17:25.596179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:25.596141    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:25.596389 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.596319    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:17:25.596389 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.596362    2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:17:25.596389 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.596377    2570 projected.go:194] Error preparing data for projected volume kube-api-access-wnxqx for pod openshift-network-diagnostics/network-check-target-r8pjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:25.596514 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.596449    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx podName:2a15d5fd-412f-44ef-a5f9-08462c299646 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:57.59642866 +0000 UTC m=+66.325335374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wnxqx" (UniqueName: "kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx") pod "network-check-target-r8pjx" (UID: "2a15d5fd-412f-44ef-a5f9-08462c299646") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:17:25.873538 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:25.873499    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:25.873734 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:25.873634    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8pjx" podUID="2a15d5fd-412f-44ef-a5f9-08462c299646"
May 28 07:17:26.873423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:26.873397    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:26.873785 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:26.873397    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:26.873785 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:26.873506    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48cgt" podUID="a3d00dbf-6569-4d01-9db6-3eb65903a4e7"
May 28 07:17:26.873785 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:26.873567    2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdf7z" podUID="bef55471-f8e6-4583-9731-ff4fa58fecb3"
May 28 07:17:27.046608 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.046576    2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-201.ec2.internal" event="NodeReady"
May 28 07:17:27.046765 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.046699    2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 07:17:27.092279 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.092184    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8szw5"]
May 28 07:17:27.117514 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.117470    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8q766"]
May 28 07:17:27.117763 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.117687    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.122505 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.122473    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 07:17:27.122762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.122744    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 07:17:27.123048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.123026    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9s6nw\""
May 28 07:17:27.146897 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.146870    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q766"]
May 28 07:17:27.146897 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.146903    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8szw5"]
May 28 07:17:27.147092 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.147013    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.149623 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.149594    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k5q9b\""
May 28 07:17:27.149623 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.149610    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 07:17:27.149945 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.149630    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 07:17:27.149945 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.149594    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 07:17:27.208384 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.208316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e84310f-06d6-4835-b848-441d2e2a4da1-config-volume\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.208384 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.208388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e84310f-06d6-4835-b848-441d2e2a4da1-tmp-dir\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.208594 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.208412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fxm9\" (UniqueName: \"kubernetes.io/projected/3e84310f-06d6-4835-b848-441d2e2a4da1-kube-api-access-8fxm9\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.208594 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.208503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.309697 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309658    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6kln\" (UniqueName: \"kubernetes.io/projected/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-kube-api-access-p6kln\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.309872 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309730    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e84310f-06d6-4835-b848-441d2e2a4da1-config-volume\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.309872 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309789    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e84310f-06d6-4835-b848-441d2e2a4da1-tmp-dir\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.309872 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309826    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fxm9\" (UniqueName: \"kubernetes.io/projected/3e84310f-06d6-4835-b848-441d2e2a4da1-kube-api-access-8fxm9\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.310025 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309879    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.310025 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.309911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.310087 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.310072    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:27.310146 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.310118    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e84310f-06d6-4835-b848-441d2e2a4da1-tmp-dir\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.310146 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.310141    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:27.810119617 +0000 UTC m=+36.539026342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:27.310356 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.310265    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e84310f-06d6-4835-b848-441d2e2a4da1-config-volume\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.323263 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.323231    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fxm9\" (UniqueName: \"kubernetes.io/projected/3e84310f-06d6-4835-b848-441d2e2a4da1-kube-api-access-8fxm9\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.410485 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.410392    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.410485 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.410463    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6kln\" (UniqueName: \"kubernetes.io/projected/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-kube-api-access-p6kln\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.410722 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.410572    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:27.410722 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.410670    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:27.910646675 +0000 UTC m=+36.639553402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:27.419902 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.419873    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6kln\" (UniqueName: \"kubernetes.io/projected/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-kube-api-access-p6kln\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.813006 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.812965    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:27.813200 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.813146    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:27.813240 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.813219    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:28.813201125 +0000 UTC m=+37.542107848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:27.874007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.873952    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:27.876929 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.876896    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 07:17:27.877084 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.876965    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 07:17:27.877084 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.876981    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6pjh\""
May 28 07:17:27.913792 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:27.913762    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:27.913937 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.913908    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:27.913983 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:27.913977    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:28.913961963 +0000 UTC m=+37.642868675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:28.821046 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.821004    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:28.821248 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:28.821162    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:28.821248 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:28.821224    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:30.821207923 +0000 UTC m=+39.550114635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:28.873964 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.873925    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:28.874141 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.873927    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:28.876822 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.876796    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 07:17:28.876822 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.876823    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vdkv\""
May 28 07:17:28.876972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.876869    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 07:17:28.921526 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:28.921482    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:28.921687 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:28.921652    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:28.921750 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:28.921720    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:30.921700035 +0000 UTC m=+39.650606764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:30.837950 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:30.837911    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:30.838378 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:30.838071    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:30.838378 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:30.838137    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:34.8381183 +0000 UTC m=+43.567025011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:30.938610 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:30.938572    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:30.938777 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:30.938703    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:30.938777 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:30.938765    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:34.93874982 +0000 UTC m=+43.667656532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:31.060898 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:31.060860    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="e47b22f1c129f7d643f31a3ed8651c60ba8e2b53ff86dc1b71dcbebe27daa9b5" exitCode=0
May 28 07:17:31.061090 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:31.060906    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"e47b22f1c129f7d643f31a3ed8651c60ba8e2b53ff86dc1b71dcbebe27daa9b5"}
May 28 07:17:32.064975 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:32.064934    2570 generic.go:358] "Generic (PLEG): container finished" podID="9a805528-1688-4c27-b36d-74df2df15f70" containerID="0145454679aa99be38b56367aba89442652f586188b4b99255a731fc334f5f1c" exitCode=0
May 28 07:17:32.065410 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:32.065015    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerDied","Data":"0145454679aa99be38b56367aba89442652f586188b4b99255a731fc334f5f1c"}
May 28 07:17:33.069581 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:33.069544    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s27sk" event={"ID":"9a805528-1688-4c27-b36d-74df2df15f70","Type":"ContainerStarted","Data":"b0a219792421872aaeedf51394102f3507b79c884b465f95928de2aed4079300"}
May 28 07:17:33.091181 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:33.091129    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s27sk" podStartSLOduration=5.510987554 podStartE2EDuration="41.091113262s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:16:54.573239949 +0000 UTC m=+3.302146665" lastFinishedPulling="2026-05-28 07:17:30.153365653 +0000 UTC m=+38.882272373" observedRunningTime="2026-05-28 07:17:33.08957844 +0000 UTC m=+41.818485174" watchObservedRunningTime="2026-05-28 07:17:33.091113262 +0000 UTC m=+41.820020033"
May 28 07:17:34.867207 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:34.867166    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:34.867660 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:34.867356    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:34.867660 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:34.867430    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:42.867414378 +0000 UTC m=+51.596321096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:34.967766 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:34.967726    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:34.967766 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:34.967769    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:34.968016 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:34.967887    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:34.968016 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:34.967972    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:42.967949095 +0000 UTC m=+51.696855810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:34.970867 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:34.970841    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bef55471-f8e6-4583-9731-ff4fa58fecb3-original-pull-secret\") pod \"global-pull-secret-syncer-wdf7z\" (UID: \"bef55471-f8e6-4583-9731-ff4fa58fecb3\") " pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:35.185886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:35.185771    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdf7z"
May 28 07:17:35.318746 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:35.318714    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdf7z"]
May 28 07:17:35.322619 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:17:35.322578    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef55471_f8e6_4583_9731_ff4fa58fecb3.slice/crio-ed7c0b94a4945b34814baf9103b47a99f7220ee2260d7e0cece5173b3f76d1db WatchSource:0}: Error finding container ed7c0b94a4945b34814baf9103b47a99f7220ee2260d7e0cece5173b3f76d1db: Status 404 returned error can't find the container with id ed7c0b94a4945b34814baf9103b47a99f7220ee2260d7e0cece5173b3f76d1db
May 28 07:17:36.075715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:36.075673    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdf7z" event={"ID":"bef55471-f8e6-4583-9731-ff4fa58fecb3","Type":"ContainerStarted","Data":"ed7c0b94a4945b34814baf9103b47a99f7220ee2260d7e0cece5173b3f76d1db"}
May 28 07:17:41.087903 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:41.087860    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdf7z" event={"ID":"bef55471-f8e6-4583-9731-ff4fa58fecb3","Type":"ContainerStarted","Data":"c0a2f7fe1357cb7430075160ac57ecc267e229699a789207ca46274940996de2"}
May 28 07:17:41.102050 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:41.101994    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wdf7z" podStartSLOduration=33.450561063 podStartE2EDuration="38.101982281s" podCreationTimestamp="2026-05-28 07:17:03 +0000 UTC" firstStartedPulling="2026-05-28 07:17:35.324512131 +0000 UTC m=+44.053418846" lastFinishedPulling="2026-05-28 07:17:39.975933348 +0000 UTC m=+48.704840064" observedRunningTime="2026-05-28 07:17:41.101895683 +0000 UTC m=+49.830802417" watchObservedRunningTime="2026-05-28 07:17:41.101982281 +0000 UTC m=+49.830889009"
May 28 07:17:42.923096 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:42.923054    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:42.923571 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:42.923168    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:42.923571 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:42.923267    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:17:58.923252582 +0000 UTC m=+67.652159294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:43.024119 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:43.024074    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:43.024312 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:43.024196    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:43.024312 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:43.024256    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:17:59.024242124 +0000 UTC m=+67.753148836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:51.056430 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:51.056396    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2xgnb"
May 28 07:17:57.531798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.531759    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:17:57.535130 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.535099    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 07:17:57.542150 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:57.542114    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 07:17:57.542288 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:57.542218    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs podName:a3d00dbf-6569-4d01-9db6-3eb65903a4e7 nodeName:}" failed. No retries permitted until 2026-05-28 07:19:01.542200181 +0000 UTC m=+130.271106897 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs") pod "network-metrics-daemon-48cgt" (UID: "a3d00dbf-6569-4d01-9db6-3eb65903a4e7") : secret "metrics-daemon-secret" not found
May 28 07:17:57.632387 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.632348    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:57.635054 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.635037    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 07:17:57.645468 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.645447    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 07:17:57.655894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.655868    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxqx\" (UniqueName: \"kubernetes.io/projected/2a15d5fd-412f-44ef-a5f9-08462c299646-kube-api-access-wnxqx\") pod \"network-check-target-r8pjx\" (UID: \"2a15d5fd-412f-44ef-a5f9-08462c299646\") " pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:57.886507 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.886476    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6pjh\""
May 28 07:17:57.894558 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:57.894532    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:17:58.036402 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:58.036370    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8pjx"]
May 28 07:17:58.040199 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:17:58.040152    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a15d5fd_412f_44ef_a5f9_08462c299646.slice/crio-21eaf6947ee3f37dff7db2c934b0d97c847b015416ba3803de2990f8f308d3fa WatchSource:0}: Error finding container 21eaf6947ee3f37dff7db2c934b0d97c847b015416ba3803de2990f8f308d3fa: Status 404 returned error can't find the container with id 21eaf6947ee3f37dff7db2c934b0d97c847b015416ba3803de2990f8f308d3fa
May 28 07:17:58.124037 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:58.123998    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8pjx" event={"ID":"2a15d5fd-412f-44ef-a5f9-08462c299646","Type":"ContainerStarted","Data":"21eaf6947ee3f37dff7db2c934b0d97c847b015416ba3803de2990f8f308d3fa"}
May 28 07:17:58.940562 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:58.940526    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:17:58.941080 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:58.940663    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:17:58.941080 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:58.940726    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls podName:3e84310f-06d6-4835-b848-441d2e2a4da1 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:30.940706778 +0000 UTC m=+99.669613491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls") pod "dns-default-8szw5" (UID: "3e84310f-06d6-4835-b848-441d2e2a4da1") : secret "dns-default-metrics-tls" not found
May 28 07:17:59.041470 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.041434    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:17:59.041639 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.041593    2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:17:59.041690 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.041656    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert podName:5ad0fd15-20a2-44fc-969d-0468e04b4bdc nodeName:}" failed. No retries permitted until 2026-05-28 07:18:31.041637408 +0000 UTC m=+99.770544138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert") pod "ingress-canary-8q766" (UID: "5ad0fd15-20a2-44fc-969d-0468e04b4bdc") : secret "canary-serving-cert" not found
May 28 07:17:59.519277 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.519237    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"]
May 28 07:17:59.521463 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.521405    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.526385 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.526365    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 07:17:59.526385 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.526381    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 07:17:59.526597 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.526409    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 07:17:59.526597 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.526369    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 07:17:59.526597 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.526367    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-96pvq\""
May 28 07:17:59.533624 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.533600    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"]
May 28 07:17:59.545805 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.545771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.545941 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.545841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.545941 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.545868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gswnd\" (UniqueName: \"kubernetes.io/projected/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-kube-api-access-gswnd\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.626732 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.626692    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"]
May 28 07:17:59.628875 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.628846    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.630795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.630773    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"]
May 28 07:17:59.631635 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.631611    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 28 07:17:59.631635 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.631626    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 28 07:17:59.631849 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.631677    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-whdxr\""
May 28 07:17:59.632057 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.632030    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 28 07:17:59.633189 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.632777    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:17:59.633189 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.632932    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"
May 28 07:17:59.635717 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.634905    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.635717 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.635294    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 07:17:59.635717 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.635353    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 07:17:59.635717 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.635559    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qbf94\""
May 28 07:17:59.637969 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.637949    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 07:17:59.638302 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.638284    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 07:17:59.638583 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.638557    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ssv96\""
May 28 07:17:59.638687 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.638638    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 07:17:59.646361 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.646314    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"]
May 28 07:17:59.648088 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.646830    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.648424 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648518    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648565    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gswnd\" (UniqueName: \"kubernetes.io/projected/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-kube-api-access-gswnd\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbj9\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkcl\" (UniqueName: \"kubernetes.io/projected/325455d5-5b75-44ab-9940-f659e8df5de4-kube-api-access-dlkcl\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czrnc\" (UniqueName: \"kubernetes.io/projected/59b3e7c9-72be-43a3-aa28-af25ac45b27d-kube-api-access-czrnc\") pod \"volume-data-source-validator-5cf8c89d64-nhvml\" (UID: \"59b3e7c9-72be-43a3-aa28-af25ac45b27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648831    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"]
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.648850    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.649234 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.649218    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:17:59.649794 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.649292    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:00.149263296 +0000 UTC m=+68.878170011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:17:59.649794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.649317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.649388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.649423    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.649794 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.649726    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.653261 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.653236    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 07:17:59.664826 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.664803    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:17:59.668394 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.668365    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gswnd\" (UniqueName: \"kubernetes.io/projected/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-kube-api-access-gswnd\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:17:59.726739 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.726700    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"]
May 28 07:17:59.729022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.728999    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.731871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.731685    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 07:17:59.731871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.731750    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 07:17:59.731871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.731687    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 07:17:59.731871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.731686    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j6r45\""
May 28 07:17:59.731871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.731697    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 07:17:59.738828 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.738802    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"]
May 28 07:17:59.750486 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750462    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.750622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750505    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zt9t\" (UniqueName: \"kubernetes.io/projected/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-kube-api-access-4zt9t\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.750622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750553    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbj9\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.750622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750578    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkcl\" (UniqueName: \"kubernetes.io/projected/325455d5-5b75-44ab-9940-f659e8df5de4-kube-api-access-dlkcl\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.750622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750607    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czrnc\" (UniqueName: \"kubernetes.io/projected/59b3e7c9-72be-43a3-aa28-af25ac45b27d-kube-api-access-czrnc\") pod \"volume-data-source-validator-5cf8c89d64-nhvml\" (UID: \"59b3e7c9-72be-43a3-aa28-af25ac45b27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"
May 28 07:17:59.750836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750707    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.750836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750754    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.750836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750784    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.750836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-serving-cert\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750846    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-config\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750886    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750916    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750944    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.750985    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 07:17:59.751034 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.750994    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.751319 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.751047    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls podName:325455d5-5b75-44ab-9940-f659e8df5de4 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:00.251026174 +0000 UTC m=+68.979932901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls") pod "cluster-samples-operator-697587599-bcmsd" (UID: "325455d5-5b75-44ab-9940-f659e8df5de4") : secret "samples-operator-tls" not found
May 28 07:17:59.751319 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.751107    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.751319 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.751204    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:17:59.751319 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.751218    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b468cb5f7-xgf4j: secret "image-registry-tls" not found
May 28 07:17:59.751319 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:17:59.751268    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls podName:46d6acc7-bb13-4ada-b484-84bf3d21b89b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:00.251246835 +0000 UTC m=+68.980153550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls") pod "image-registry-7b468cb5f7-xgf4j" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b") : secret "image-registry-tls" not found
May 28 07:17:59.751758 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.751734    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.752183 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.752160    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.753778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.753756    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.753915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.753895    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.760026 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.759979    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.760026 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.760015    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbj9\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:17:59.760198 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.760129    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czrnc\" (UniqueName: \"kubernetes.io/projected/59b3e7c9-72be-43a3-aa28-af25ac45b27d-kube-api-access-czrnc\") pod \"volume-data-source-validator-5cf8c89d64-nhvml\" (UID: \"59b3e7c9-72be-43a3-aa28-af25ac45b27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"
May 28 07:17:59.761001 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.760977    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkcl\" (UniqueName: \"kubernetes.io/projected/325455d5-5b75-44ab-9940-f659e8df5de4-kube-api-access-dlkcl\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:17:59.852417 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.852358    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-config\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.852665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.852509    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zt9t\" (UniqueName: \"kubernetes.io/projected/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-kube-api-access-4zt9t\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.852665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.852618    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-serving-cert\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.853145 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.853118    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-config\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.855809 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.855785    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-serving-cert\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.861204 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.861112    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zt9t\" (UniqueName: \"kubernetes.io/projected/f12fdcfa-f4d1-4ec2-a58e-4d739410538f-kube-api-access-4zt9t\") pod \"service-ca-operator-57b5b68b8-fxlzs\" (UID: \"f12fdcfa-f4d1-4ec2-a58e-4d739410538f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:17:59.951268 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:17:59.951228    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"
May 28 07:18:00.040831 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.040787    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"
May 28 07:18:00.099792 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.099737    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml"]
May 28 07:18:00.105660 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:00.105548    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b3e7c9_72be_43a3_aa28_af25ac45b27d.slice/crio-1606e98cb94449d5b3f13122f2ab902648d9c9bf82ed6d268a4ca7ffb6cd9f25 WatchSource:0}: Error finding container 1606e98cb94449d5b3f13122f2ab902648d9c9bf82ed6d268a4ca7ffb6cd9f25: Status 404 returned error can't find the container with id 1606e98cb94449d5b3f13122f2ab902648d9c9bf82ed6d268a4ca7ffb6cd9f25
May 28 07:18:00.129763 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.129727    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml" event={"ID":"59b3e7c9-72be-43a3-aa28-af25ac45b27d","Type":"ContainerStarted","Data":"1606e98cb94449d5b3f13122f2ab902648d9c9bf82ed6d268a4ca7ffb6cd9f25"}
May 28 07:18:00.155220 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.155185    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:00.155422 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.155374    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:18:00.155485 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.155449    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:01.155428719 +0000 UTC m=+69.884335449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:18:00.179343 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.179288    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs"]
May 28 07:18:00.183491 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:00.183457    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12fdcfa_f4d1_4ec2_a58e_4d739410538f.slice/crio-af120af21e598835abc7ae96965adc7435adb8c77a83b3512fee937a53ba8c98 WatchSource:0}: Error finding container af120af21e598835abc7ae96965adc7435adb8c77a83b3512fee937a53ba8c98: Status 404 returned error can't find the container with id af120af21e598835abc7ae96965adc7435adb8c77a83b3512fee937a53ba8c98
May 28 07:18:00.255956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.255908    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:00.256172 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:00.255975    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:00.256172 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.256061    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 07:18:00.256172 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.256147    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:18:00.256172 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.256172    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b468cb5f7-xgf4j: secret "image-registry-tls" not found
May 28 07:18:00.256422 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.256163    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls podName:325455d5-5b75-44ab-9940-f659e8df5de4 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:01.256145232 +0000 UTC m=+69.985051944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls") pod "cluster-samples-operator-697587599-bcmsd" (UID: "325455d5-5b75-44ab-9940-f659e8df5de4") : secret "samples-operator-tls" not found
May 28 07:18:00.256422 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:00.256260    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls podName:46d6acc7-bb13-4ada-b484-84bf3d21b89b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:01.256239987 +0000 UTC m=+69.985146705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls") pod "image-registry-7b468cb5f7-xgf4j" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b") : secret "image-registry-tls" not found
May 28 07:18:01.132757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:01.132709    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs" event={"ID":"f12fdcfa-f4d1-4ec2-a58e-4d739410538f","Type":"ContainerStarted","Data":"af120af21e598835abc7ae96965adc7435adb8c77a83b3512fee937a53ba8c98"}
May 28 07:18:01.163705 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:01.163666    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:01.163904 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.163837    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:18:01.163971 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.163918    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:03.163899711 +0000 UTC m=+71.892806423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:18:01.264252 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:01.264193    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:01.264424 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:01.264279    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:01.264424 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.264381    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 07:18:01.264526 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.264460    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls podName:325455d5-5b75-44ab-9940-f659e8df5de4 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:03.264440384 +0000 UTC m=+71.993347099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls") pod "cluster-samples-operator-697587599-bcmsd" (UID: "325455d5-5b75-44ab-9940-f659e8df5de4") : secret "samples-operator-tls" not found
May 28 07:18:01.264526 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.264485    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:18:01.264526 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.264504    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b468cb5f7-xgf4j: secret "image-registry-tls" not found
May 28 07:18:01.264680 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:01.264564    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls podName:46d6acc7-bb13-4ada-b484-84bf3d21b89b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:03.264549701 +0000 UTC m=+71.993456413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls") pod "image-registry-7b468cb5f7-xgf4j" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b") : secret "image-registry-tls" not found
May 28 07:18:02.136932 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:02.136893    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8pjx" event={"ID":"2a15d5fd-412f-44ef-a5f9-08462c299646","Type":"ContainerStarted","Data":"5481d4c0763d203c9205ea2f85697fdfcf5532ef240d841b43fc268e7f19d9e5"}
May 28 07:18:02.137401 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:02.137033    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:18:02.154289 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:02.154233    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8pjx" podStartSLOduration=66.966924411 podStartE2EDuration="1m10.15421341s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:17:58.041920055 +0000 UTC m=+66.770826767" lastFinishedPulling="2026-05-28 07:18:01.229209046 +0000 UTC m=+69.958115766" observedRunningTime="2026-05-28 07:18:02.152364252 +0000 UTC m=+70.881270990" watchObservedRunningTime="2026-05-28 07:18:02.15421341 +0000 UTC m=+70.883120143"
May 28 07:18:03.140746 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:03.140702    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml" event={"ID":"59b3e7c9-72be-43a3-aa28-af25ac45b27d","Type":"ContainerStarted","Data":"7de217870e27f82f4799b3b6e60e346eea3c0c6c361464eff384d394fdea97dd"}
May 28 07:18:03.155073 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:03.155007    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nhvml" podStartSLOduration=1.970954791 podStartE2EDuration="4.154983373s" podCreationTimestamp="2026-05-28 07:17:59 +0000 UTC" firstStartedPulling="2026-05-28 07:18:00.112821835 +0000 UTC m=+68.841728548" lastFinishedPulling="2026-05-28 07:18:02.296850414 +0000 UTC m=+71.025757130" observedRunningTime="2026-05-28 07:18:03.153981425 +0000 UTC m=+71.882888158" watchObservedRunningTime="2026-05-28 07:18:03.154983373 +0000 UTC m=+71.883890110"
May 28 07:18:03.182964 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:03.182929    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:03.183171 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.183145    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:18:03.183239 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.183228    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:07.183207327 +0000 UTC m=+75.912114044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:18:03.283894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:03.283855    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:03.284075 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:03.283919    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:03.284075 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.284032    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 07:18:03.284075 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.284059    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:18:03.284075 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.284074    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b468cb5f7-xgf4j: secret "image-registry-tls" not found
May 28 07:18:03.284213 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.284110    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls podName:325455d5-5b75-44ab-9940-f659e8df5de4 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:07.284089445 +0000 UTC m=+76.012996157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls") pod "cluster-samples-operator-697587599-bcmsd" (UID: "325455d5-5b75-44ab-9940-f659e8df5de4") : secret "samples-operator-tls" not found
May 28 07:18:03.284213 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:03.284125    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls podName:46d6acc7-bb13-4ada-b484-84bf3d21b89b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:07.284119352 +0000 UTC m=+76.013026064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls") pod "image-registry-7b468cb5f7-xgf4j" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b") : secret "image-registry-tls" not found
May 28 07:18:04.144353 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:04.144205    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs" event={"ID":"f12fdcfa-f4d1-4ec2-a58e-4d739410538f","Type":"ContainerStarted","Data":"7d52fb167bf8cce67c7b021e4248f2a7ff8963e515f125d2e94dc7d0c6c9c01d"}
May 28 07:18:04.163259 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:04.163187    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs" podStartSLOduration=1.8993342119999999 podStartE2EDuration="5.163170884s" podCreationTimestamp="2026-05-28 07:17:59 +0000 UTC" firstStartedPulling="2026-05-28 07:18:00.185696906 +0000 UTC m=+68.914603618" lastFinishedPulling="2026-05-28 07:18:03.449533578 +0000 UTC m=+72.178440290" observedRunningTime="2026-05-28 07:18:04.162269998 +0000 UTC m=+72.891176733" watchObservedRunningTime="2026-05-28 07:18:04.163170884 +0000 UTC m=+72.892077687"
May 28 07:18:06.739969 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.739936    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bkplg"]
May 28 07:18:06.741988 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.741969    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.744406 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.744373    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 07:18:06.744406 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.744376    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 07:18:06.744568 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.744438    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 07:18:06.745325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.745308    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pb754\""
May 28 07:18:06.745427 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.745389    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 07:18:06.751846 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.751821    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bkplg"]
May 28 07:18:06.811602 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.811562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-cabundle\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.811602 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.811596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46sxp\" (UniqueName: \"kubernetes.io/projected/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-kube-api-access-46sxp\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.811866 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.811694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-key\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.913098 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.913064    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-cabundle\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.913098 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.913102    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46sxp\" (UniqueName: \"kubernetes.io/projected/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-kube-api-access-46sxp\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.913292 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.913269    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-key\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.913766 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.913738    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-cabundle\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.915832 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.915812    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-signing-key\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:06.921264 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:06.921237    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46sxp\" (UniqueName: \"kubernetes.io/projected/1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d-kube-api-access-46sxp\") pod \"service-ca-67d667c7d-bkplg\" (UID: \"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d\") " pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:07.050776 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.050743    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bkplg"
May 28 07:18:07.128176 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.128151    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tzs7h_cd3587d4-3dec-4896-9b9a-7c51839245e2/dns-node-resolver/0.log"
May 28 07:18:07.178347 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.178295    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bkplg"]
May 28 07:18:07.182116 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:07.182084    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3e35b1_ae3b_47f6_a5db_2e93dda53d6d.slice/crio-1f59ed2f372c9853fac2691399ef6bd258e404d77e419290009a0c796aa699cf WatchSource:0}: Error finding container 1f59ed2f372c9853fac2691399ef6bd258e404d77e419290009a0c796aa699cf: Status 404 returned error can't find the container with id 1f59ed2f372c9853fac2691399ef6bd258e404d77e419290009a0c796aa699cf
May 28 07:18:07.215633 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.215594    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:07.215765 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.215736    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:18:07.215817 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.215810    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:15.215793622 +0000 UTC m=+83.944700334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:18:07.316270 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.316166    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.316288    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.316361    2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.316385    2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b468cb5f7-xgf4j: secret "image-registry-tls" not found
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.316413    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.316454    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls podName:46d6acc7-bb13-4ada-b484-84bf3d21b89b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:15.316433745 +0000 UTC m=+84.045340464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls") pod "image-registry-7b468cb5f7-xgf4j" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b") : secret "image-registry-tls" not found
May 28 07:18:07.316478 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:07.316471    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls podName:325455d5-5b75-44ab-9940-f659e8df5de4 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:15.316463171 +0000 UTC m=+84.045369883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls") pod "cluster-samples-operator-697587599-bcmsd" (UID: "325455d5-5b75-44ab-9940-f659e8df5de4") : secret "samples-operator-tls" not found
May 28 07:18:07.727602 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:07.727524    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-894dv_83bca63d-7be2-4448-b3e6-979e625f7582/node-ca/0.log"
May 28 07:18:08.154970 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:08.154932    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bkplg" event={"ID":"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d","Type":"ContainerStarted","Data":"3649663d8d33cb801f999cb8d1a7cf7b1166dba6adc427005e66b96fda7e4e75"}
May 28 07:18:08.154970 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:08.154969    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bkplg" event={"ID":"1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d","Type":"ContainerStarted","Data":"1f59ed2f372c9853fac2691399ef6bd258e404d77e419290009a0c796aa699cf"}
May 28 07:18:08.172861 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:08.172812    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bkplg" podStartSLOduration=2.172792981 podStartE2EDuration="2.172792981s" podCreationTimestamp="2026-05-28 07:18:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:18:08.172240935 +0000 UTC m=+76.901147670" watchObservedRunningTime="2026-05-28 07:18:08.172792981 +0000 UTC m=+76.901699743"
May 28 07:18:15.282068 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.282025    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:15.282569 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:15.282155    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 07:18:15.282569 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:15.282219    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls podName:6dbc55b7-906d-4d5f-8a72-65500a7fd34b nodeName:}" failed. No retries permitted until 2026-05-28 07:18:31.282204046 +0000 UTC m=+100.011110763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-vpfps" (UID: "6dbc55b7-906d-4d5f-8a72-65500a7fd34b") : secret "cluster-monitoring-operator-tls" not found
May 28 07:18:15.383324 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.383279    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:15.383552 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.383411    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:15.385955 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.385923    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"image-registry-7b468cb5f7-xgf4j\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") " pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:15.386068 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.385935    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/325455d5-5b75-44ab-9940-f659e8df5de4-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bcmsd\" (UID: \"325455d5-5b75-44ab-9940-f659e8df5de4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:15.543944 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.543904    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"
May 28 07:18:15.560850 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.560819    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:15.693931 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.693778    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd"]
May 28 07:18:15.712453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:15.712420    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:18:15.718651 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:15.717841    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d6acc7_bb13_4ada_b484_84bf3d21b89b.slice/crio-b0fb534586b26e9e91f3e9edec7f783a677aa1b7e87a3a0fa3fa290f42e00438 WatchSource:0}: Error finding container b0fb534586b26e9e91f3e9edec7f783a677aa1b7e87a3a0fa3fa290f42e00438: Status 404 returned error can't find the container with id b0fb534586b26e9e91f3e9edec7f783a677aa1b7e87a3a0fa3fa290f42e00438
May 28 07:18:16.177193 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:16.177148    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd" event={"ID":"325455d5-5b75-44ab-9940-f659e8df5de4","Type":"ContainerStarted","Data":"5a2da82a56afbf8fe7565b481d024cacd053ba08c694786b1779e3e20f5e26a3"}
May 28 07:18:16.179009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:16.178964    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" event={"ID":"46d6acc7-bb13-4ada-b484-84bf3d21b89b","Type":"ContainerStarted","Data":"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"}
May 28 07:18:16.179161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:16.179018    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" event={"ID":"46d6acc7-bb13-4ada-b484-84bf3d21b89b","Type":"ContainerStarted","Data":"b0fb534586b26e9e91f3e9edec7f783a677aa1b7e87a3a0fa3fa290f42e00438"}
May 28 07:18:16.179161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:16.179141    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:16.197883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:16.197825    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" podStartSLOduration=17.197805525 podStartE2EDuration="17.197805525s" podCreationTimestamp="2026-05-28 07:17:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:18:16.196047733 +0000 UTC m=+84.924954471" watchObservedRunningTime="2026-05-28 07:18:16.197805525 +0000 UTC m=+84.926712253"
May 28 07:18:18.185534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:18.185500    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd" event={"ID":"325455d5-5b75-44ab-9940-f659e8df5de4","Type":"ContainerStarted","Data":"7eaf892d8adbbda5c738d6e97e7fd7c1bea8ce3fb8d300fb9267dc39ddd98b5b"}
May 28 07:18:19.189491 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:19.189452    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd" event={"ID":"325455d5-5b75-44ab-9940-f659e8df5de4","Type":"ContainerStarted","Data":"cec9421a1ff7b51a07aa918d92c85e5abb55c3275bd4ec0ac57f065b8010ab68"}
May 28 07:18:19.206276 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:19.206224    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bcmsd" podStartSLOduration=17.855122375 podStartE2EDuration="20.206209268s" podCreationTimestamp="2026-05-28 07:17:59 +0000 UTC" firstStartedPulling="2026-05-28 07:18:15.728817567 +0000 UTC m=+84.457724282" lastFinishedPulling="2026-05-28 07:18:18.079904451 +0000 UTC m=+86.808811175" observedRunningTime="2026-05-28 07:18:19.20490027 +0000 UTC m=+87.933807003" watchObservedRunningTime="2026-05-28 07:18:19.206209268 +0000 UTC m=+87.935115999"
May 28 07:18:25.337938 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.337902    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:18:25.364273 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.364242    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fs5hf"]
May 28 07:18:25.366953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.366933    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.370041 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.370009    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 07:18:25.370041 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.370027    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 07:18:25.370305 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.370290    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 07:18:25.375326 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.375306    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 07:18:25.375711 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.375695    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-59nkl\""
May 28 07:18:25.388227 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.388194    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fs5hf"]
May 28 07:18:25.469236 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.469202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.469409 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.469271    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzgd2\" (UniqueName: \"kubernetes.io/projected/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-api-access-pzgd2\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.469409 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.469303    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aadcea9-42a8-44ca-ab25-5eb750c3f713-data-volume\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.469409 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.469349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aadcea9-42a8-44ca-ab25-5eb750c3f713-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.469516 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.469416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aadcea9-42a8-44ca-ab25-5eb750c3f713-crio-socket\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.570580 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570537    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aadcea9-42a8-44ca-ab25-5eb750c3f713-crio-socket\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.570755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570617    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.570755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570678    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aadcea9-42a8-44ca-ab25-5eb750c3f713-crio-socket\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.570755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570677    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzgd2\" (UniqueName: \"kubernetes.io/projected/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-api-access-pzgd2\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.570755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570732    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aadcea9-42a8-44ca-ab25-5eb750c3f713-data-volume\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.571019 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.570771    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aadcea9-42a8-44ca-ab25-5eb750c3f713-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.571143 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.571121    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aadcea9-42a8-44ca-ab25-5eb750c3f713-data-volume\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.571205 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.571162    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.573487 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.573462    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aadcea9-42a8-44ca-ab25-5eb750c3f713-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.582363 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.582317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzgd2\" (UniqueName: \"kubernetes.io/projected/4aadcea9-42a8-44ca-ab25-5eb750c3f713-kube-api-access-pzgd2\") pod \"insights-runtime-extractor-fs5hf\" (UID: \"4aadcea9-42a8-44ca-ab25-5eb750c3f713\") " pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.675806 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.675711    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fs5hf"
May 28 07:18:25.799689 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:25.799656    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fs5hf"]
May 28 07:18:25.802919 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:25.802885    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aadcea9_42a8_44ca_ab25_5eb750c3f713.slice/crio-3c62a06246a5373e1afb4f7ae7e7e06cd1e0a4fa2eb9478e13d2d8bdfe45e98d WatchSource:0}: Error finding container 3c62a06246a5373e1afb4f7ae7e7e06cd1e0a4fa2eb9478e13d2d8bdfe45e98d: Status 404 returned error can't find the container with id 3c62a06246a5373e1afb4f7ae7e7e06cd1e0a4fa2eb9478e13d2d8bdfe45e98d
May 28 07:18:26.208440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:26.208399    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs5hf" event={"ID":"4aadcea9-42a8-44ca-ab25-5eb750c3f713","Type":"ContainerStarted","Data":"cd2962476b59af3fc9bb4488621085a461769897ed3b882b822985b0df937c7a"}
May 28 07:18:26.208440 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:26.208443    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs5hf" event={"ID":"4aadcea9-42a8-44ca-ab25-5eb750c3f713","Type":"ContainerStarted","Data":"3c62a06246a5373e1afb4f7ae7e7e06cd1e0a4fa2eb9478e13d2d8bdfe45e98d"}
May 28 07:18:27.212503 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:27.212463    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs5hf" event={"ID":"4aadcea9-42a8-44ca-ab25-5eb750c3f713","Type":"ContainerStarted","Data":"fac0a549596db1a83625101e1275aaaaf175e55b9ac321028c74bf4fedab43f8"}
May 28 07:18:28.216598 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:28.216564    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs5hf" event={"ID":"4aadcea9-42a8-44ca-ab25-5eb750c3f713","Type":"ContainerStarted","Data":"85ba05ff6fd844c50ef48d9bc5415f166ee39215e4a46fb05a12198ef77d5e29"}
May 28 07:18:28.233234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:28.233183    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fs5hf" podStartSLOduration=1.076357284 podStartE2EDuration="3.233168739s" podCreationTimestamp="2026-05-28 07:18:25 +0000 UTC" firstStartedPulling="2026-05-28 07:18:25.857196431 +0000 UTC m=+94.586103157" lastFinishedPulling="2026-05-28 07:18:28.014007897 +0000 UTC m=+96.742914612" observedRunningTime="2026-05-28 07:18:28.231923881 +0000 UTC m=+96.960830617" watchObservedRunningTime="2026-05-28 07:18:28.233168739 +0000 UTC m=+96.962075473"
May 28 07:18:31.018692 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.018636    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:18:31.021124 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.021093    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84310f-06d6-4835-b848-441d2e2a4da1-metrics-tls\") pod \"dns-default-8szw5\" (UID: \"3e84310f-06d6-4835-b848-441d2e2a4da1\") " pod="openshift-dns/dns-default-8szw5"
May 28 07:18:31.034675 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.034646    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9s6nw\""
May 28 07:18:31.042825 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.042805    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8szw5"
May 28 07:18:31.119921 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.119885    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:18:31.122321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.122296    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0fd15-20a2-44fc-969d-0468e04b4bdc-cert\") pod \"ingress-canary-8q766\" (UID: \"5ad0fd15-20a2-44fc-969d-0468e04b4bdc\") " pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:18:31.170352 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.170304    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8szw5"]
May 28 07:18:31.173201 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:31.173168    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84310f_06d6_4835_b848_441d2e2a4da1.slice/crio-c11b1cac091e47ea3262b059ca82b9586f2a39ceb4f1c6b54d10a8de5833d3f2 WatchSource:0}: Error finding container c11b1cac091e47ea3262b059ca82b9586f2a39ceb4f1c6b54d10a8de5833d3f2: Status 404 returned error can't find the container with id c11b1cac091e47ea3262b059ca82b9586f2a39ceb4f1c6b54d10a8de5833d3f2
May 28 07:18:31.228534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.228489    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8szw5" event={"ID":"3e84310f-06d6-4835-b848-441d2e2a4da1","Type":"ContainerStarted","Data":"c11b1cac091e47ea3262b059ca82b9586f2a39ceb4f1c6b54d10a8de5833d3f2"}
May 28 07:18:31.321699 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.321662    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:31.324176 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.324144    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6dbc55b7-906d-4d5f-8a72-65500a7fd34b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-vpfps\" (UID: \"6dbc55b7-906d-4d5f-8a72-65500a7fd34b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:31.333048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.333026    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"
May 28 07:18:31.359259 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.359237    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k5q9b\""
May 28 07:18:31.367210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.367186    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q766"
May 28 07:18:31.463482 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.463445    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps"]
May 28 07:18:31.482701 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:31.482635    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbc55b7_906d_4d5f_8a72_65500a7fd34b.slice/crio-4fb0e7f81373d4184460862e8411c4554b42c14874c75b5dec391c447d27da75 WatchSource:0}: Error finding container 4fb0e7f81373d4184460862e8411c4554b42c14874c75b5dec391c447d27da75: Status 404 returned error can't find the container with id 4fb0e7f81373d4184460862e8411c4554b42c14874c75b5dec391c447d27da75
May 28 07:18:31.520901 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:31.520872    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q766"]
May 28 07:18:31.524322 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:31.524298    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad0fd15_20a2_44fc_969d_0468e04b4bdc.slice/crio-012ca6d1a18a21c4d3c6697756d38d0713ac5ab83ef3e94a3c4cc36995c80a05 WatchSource:0}: Error finding container 012ca6d1a18a21c4d3c6697756d38d0713ac5ab83ef3e94a3c4cc36995c80a05: Status 404 returned error can't find the container with id 012ca6d1a18a21c4d3c6697756d38d0713ac5ab83ef3e94a3c4cc36995c80a05
May 28 07:18:32.232478 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:32.232433    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps" event={"ID":"6dbc55b7-906d-4d5f-8a72-65500a7fd34b","Type":"ContainerStarted","Data":"4fb0e7f81373d4184460862e8411c4554b42c14874c75b5dec391c447d27da75"}
May 28 07:18:32.233592 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:32.233563    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q766" event={"ID":"5ad0fd15-20a2-44fc-969d-0468e04b4bdc","Type":"ContainerStarted","Data":"012ca6d1a18a21c4d3c6697756d38d0713ac5ab83ef3e94a3c4cc36995c80a05"}
May 28 07:18:33.143661 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:33.143622    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8pjx"
May 28 07:18:34.240671 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.240627    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps" event={"ID":"6dbc55b7-906d-4d5f-8a72-65500a7fd34b","Type":"ContainerStarted","Data":"f7c44f01e241b48f9a12c964eba9b75c0217e57c4098ebd2861a56447341c674"}
May 28 07:18:34.242069 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.242031    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q766" event={"ID":"5ad0fd15-20a2-44fc-969d-0468e04b4bdc","Type":"ContainerStarted","Data":"976b82b2c10f5e6944077e4b61e702a494969de00338ce8a1a39019b40715194"}
May 28 07:18:34.243585 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.243560    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8szw5" event={"ID":"3e84310f-06d6-4835-b848-441d2e2a4da1","Type":"ContainerStarted","Data":"98e3cda9f5a7e3b7cecaf6ec13d9bc2acb048e03e426c70b67ab88c5ed3c6869"}
May 28 07:18:34.243727 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.243590    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8szw5" event={"ID":"3e84310f-06d6-4835-b848-441d2e2a4da1","Type":"ContainerStarted","Data":"e02e7e64d6f55e6f6923b853cfab9002f0d568d7bf630b570803de2ccdaa3bcc"}
May 28 07:18:34.243727 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.243715    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8szw5"
May 28 07:18:34.264736 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.264683    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-vpfps" podStartSLOduration=32.9802409 podStartE2EDuration="35.264668276s" podCreationTimestamp="2026-05-28 07:17:59 +0000 UTC" firstStartedPulling="2026-05-28 07:18:31.493734115 +0000 UTC m=+100.222640830" lastFinishedPulling="2026-05-28 07:18:33.778161491 +0000 UTC m=+102.507068206" observedRunningTime="2026-05-28 07:18:34.263367578 +0000 UTC m=+102.992274314" watchObservedRunningTime="2026-05-28 07:18:34.264668276 +0000 UTC m=+102.993575031"
May 28 07:18:34.283070 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.283013    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8szw5" podStartSLOduration=64.685242194 podStartE2EDuration="1m7.282997198s" podCreationTimestamp="2026-05-28 07:17:27 +0000 UTC" firstStartedPulling="2026-05-28 07:18:31.175038129 +0000 UTC m=+99.903944841" lastFinishedPulling="2026-05-28 07:18:33.772793129 +0000 UTC m=+102.501699845" observedRunningTime="2026-05-28 07:18:34.281902999 +0000 UTC m=+103.010809731" watchObservedRunningTime="2026-05-28 07:18:34.282997198 +0000 UTC m=+103.011903931"
May 28 07:18:34.296430 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.296365    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8q766" podStartSLOduration=65.046659698 podStartE2EDuration="1m7.296349725s" podCreationTimestamp="2026-05-28 07:17:27 +0000 UTC" firstStartedPulling="2026-05-28 07:18:31.526219497 +0000 UTC m=+100.255126209" lastFinishedPulling="2026-05-28 07:18:33.775909524 +0000 UTC m=+102.504816236" observedRunningTime="2026-05-28 07:18:34.295857784 +0000 UTC m=+103.024764517" watchObservedRunningTime="2026-05-28 07:18:34.296349725 +0000 UTC m=+103.025256457"
May 28 07:18:34.318372 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.318318    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"]
May 28 07:18:34.320430 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.320412    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:34.322851 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.322810    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 07:18:34.323011 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.322852    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lpxhh\""
May 28 07:18:34.328320 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.328270    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"]
May 28 07:18:34.447828 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.447779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27da6ccb-8333-4c83-90d2-24242dd98ab5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-57nkx\" (UID: \"27da6ccb-8333-4c83-90d2-24242dd98ab5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:34.548848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.548772    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27da6ccb-8333-4c83-90d2-24242dd98ab5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-57nkx\" (UID: \"27da6ccb-8333-4c83-90d2-24242dd98ab5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:34.551509 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.551479    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27da6ccb-8333-4c83-90d2-24242dd98ab5-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-57nkx\" (UID: \"27da6ccb-8333-4c83-90d2-24242dd98ab5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:34.632366 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.632297    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:34.760993 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:34.760960    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"]
May 28 07:18:34.765933 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:34.765900    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27da6ccb_8333_4c83_90d2_24242dd98ab5.slice/crio-c7c0bf5ea9fc3b6c36abb4378b762e07695e71428ad24015e32a9ebc457d5ac2 WatchSource:0}: Error finding container c7c0bf5ea9fc3b6c36abb4378b762e07695e71428ad24015e32a9ebc457d5ac2: Status 404 returned error can't find the container with id c7c0bf5ea9fc3b6c36abb4378b762e07695e71428ad24015e32a9ebc457d5ac2
May 28 07:18:35.248612 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:35.248570    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx" event={"ID":"27da6ccb-8333-4c83-90d2-24242dd98ab5","Type":"ContainerStarted","Data":"c7c0bf5ea9fc3b6c36abb4378b762e07695e71428ad24015e32a9ebc457d5ac2"}
May 28 07:18:35.345740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:35.345695    2570 patch_prober.go:28] interesting pod/image-registry-7b468cb5f7-xgf4j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 07:18:35.345928 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:35.345764    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 07:18:36.252769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:36.252729    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx" event={"ID":"27da6ccb-8333-4c83-90d2-24242dd98ab5","Type":"ContainerStarted","Data":"3f148b09ae544d3a9c29accf36d8f960e76aec764cb7a38fa5c21fdac10e0b0e"}
May 28 07:18:36.253166 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:36.252961    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:36.257927 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:36.257902    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx"
May 28 07:18:36.267185 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:36.267146    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-57nkx" podStartSLOduration=0.977838708 podStartE2EDuration="2.26713346s" podCreationTimestamp="2026-05-28 07:18:34 +0000 UTC" firstStartedPulling="2026-05-28 07:18:34.767791347 +0000 UTC m=+103.496698059" lastFinishedPulling="2026-05-28 07:18:36.057086082 +0000 UTC m=+104.785992811" observedRunningTime="2026-05-28 07:18:36.266017377 +0000 UTC m=+104.994924110" watchObservedRunningTime="2026-05-28 07:18:36.26713346 +0000 UTC m=+104.996040193"
May 28 07:18:41.722727 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.722685    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"]
May 28 07:18:41.725678 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.725659    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:41.730125 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.730088    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 07:18:41.731530 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.731491    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 07:18:41.731746 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.731516    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ggc99\""
May 28 07:18:41.731746 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.731577    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 07:18:41.747257 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.747230    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"]
May 28 07:18:41.749798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.749767    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"]
May 28 07:18:41.749912 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.749859    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7qr82"]
May 28 07:18:41.749912 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.749905    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.752348 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.752315    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.752986 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.752965    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 07:18:41.753106 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.753024    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mjhvw\""
May 28 07:18:41.753518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.753496    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 07:18:41.753795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.753776    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 07:18:41.754798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.754778    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 07:18:41.754900 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.754877    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 07:18:41.754966 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.754915    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mlwkd\""
May 28 07:18:41.755152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.755134    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 07:18:41.764974 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.764952    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"]
May 28 07:18:41.901297 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.901297 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-sys\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b60e2eac-1c0a-4b98-aa5c-463ec6323725-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-textfile\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-root\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5qn\" (UniqueName: \"kubernetes.io/projected/de63b126-71a8-48ca-88a3-57ed85e0c70f-kube-api-access-zf5qn\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901652    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k45m\" (UniqueName: \"kubernetes.io/projected/b60e2eac-1c0a-4b98-aa5c-463ec6323725-kube-api-access-6k45m\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-tls\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:41.901762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-wtmp\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.902007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46cbd6a3-ca2c-47fe-8455-098baf850501-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.902007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901802    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:41.902007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901876    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-metrics-client-ca\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:41.902007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901936    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:41.902007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:41.901974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lpc\" (UniqueName: \"kubernetes.io/projected/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-api-access-k6lpc\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.002519 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.002420    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-metrics-client-ca\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.002713 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.002688    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.002885 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:42.002834    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 07:18:42.002956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.002907    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lpc\" (UniqueName: \"kubernetes.io/projected/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-api-access-k6lpc\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.003014 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:42.002956    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls podName:b60e2eac-1c0a-4b98-aa5c-463ec6323725 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:42.502931637 +0000 UTC m=+111.231838356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-xkll6" (UID: "b60e2eac-1c0a-4b98-aa5c-463ec6323725") : secret "openshift-state-metrics-tls" not found
May 28 07:18:42.003072 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003007    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.003072 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003045    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-sys\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003168 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003071    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-metrics-client-ca\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003168 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003090    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003168 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003119    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b60e2eac-1c0a-4b98-aa5c-463ec6323725-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.003168 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003149    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003175    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-textfile\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003203    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-root\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003227    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003264    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003291    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5qn\" (UniqueName: \"kubernetes.io/projected/de63b126-71a8-48ca-88a3-57ed85e0c70f-kube-api-access-zf5qn\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003317    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6k45m\" (UniqueName: \"kubernetes.io/projected/b60e2eac-1c0a-4b98-aa5c-463ec6323725-kube-api-access-6k45m\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003364    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-tls\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003399    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.003439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003432    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-wtmp\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.003849 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003473    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46cbd6a3-ca2c-47fe-8455-098baf850501-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.003849 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.003497    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.004186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004162    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.004368 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004191    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.004467 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:42.004267    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 07:18:42.004581 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004561    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-textfile\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004628    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b60e2eac-1c0a-4b98-aa5c-463ec6323725-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:42.004645    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls podName:46cbd6a3-ca2c-47fe-8455-098baf850501 nodeName:}" failed. No retries permitted until 2026-05-28 07:18:42.504559194 +0000 UTC m=+111.233465912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-gzdns" (UID: "46cbd6a3-ca2c-47fe-8455-098baf850501") : secret "kube-state-metrics-tls" not found
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004632    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-root\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.004707    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-sys\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.005181    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-wtmp\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.005321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.005292    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.005937 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.005912    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46cbd6a3-ca2c-47fe-8455-098baf850501-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.006464 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.006439    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.008543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.008419    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.008543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.008488    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de63b126-71a8-48ca-88a3-57ed85e0c70f-node-exporter-tls\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.008543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.008502    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.010806 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.010777    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lpc\" (UniqueName: \"kubernetes.io/projected/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-api-access-k6lpc\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.013399 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.013355    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k45m\" (UniqueName: \"kubernetes.io/projected/b60e2eac-1c0a-4b98-aa5c-463ec6323725-kube-api-access-6k45m\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.013983 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.013927    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5qn\" (UniqueName: \"kubernetes.io/projected/de63b126-71a8-48ca-88a3-57ed85e0c70f-kube-api-access-zf5qn\") pod \"node-exporter-7qr82\" (UID: \"de63b126-71a8-48ca-88a3-57ed85e0c70f\") " pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.067909 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.067867    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qr82"
May 28 07:18:42.076118 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:42.076076    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde63b126_71a8_48ca_88a3_57ed85e0c70f.slice/crio-3cb9d315f531e07873432651499fa27881eae291109cb7936d6914ddb1d225ee WatchSource:0}: Error finding container 3cb9d315f531e07873432651499fa27881eae291109cb7936d6914ddb1d225ee: Status 404 returned error can't find the container with id 3cb9d315f531e07873432651499fa27881eae291109cb7936d6914ddb1d225ee
May 28 07:18:42.271598 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.271505    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qr82" event={"ID":"de63b126-71a8-48ca-88a3-57ed85e0c70f","Type":"ContainerStarted","Data":"3cb9d315f531e07873432651499fa27881eae291109cb7936d6914ddb1d225ee"}
May 28 07:18:42.507287 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.507250    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.507496 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.507362    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.509837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.509812    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b60e2eac-1c0a-4b98-aa5c-463ec6323725-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xkll6\" (UID: \"b60e2eac-1c0a-4b98-aa5c-463ec6323725\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.510030 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.510005    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46cbd6a3-ca2c-47fe-8455-098baf850501-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gzdns\" (UID: \"46cbd6a3-ca2c-47fe-8455-098baf850501\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.635266 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.635227    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"
May 28 07:18:42.662226 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.662022    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"
May 28 07:18:42.789380 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.788375    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:18:42.792619 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.792593    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.795148 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.795118    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g4lvb\""
May 28 07:18:42.798148 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.797961    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 07:18:42.798148 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.797961    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 07:18:42.799528 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.799476    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 07:18:42.801014 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.799907    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 07:18:42.801014 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.800133    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 07:18:42.801014 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.800988    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 07:18:42.801309 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.801193    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 07:18:42.801431 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.801410    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 07:18:42.803780 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.803759    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:18:42.804546 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.804526    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xkll6"]
May 28 07:18:42.806767 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.805985    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 07:18:42.809009 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:42.808614    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60e2eac_1c0a_4b98_aa5c_463ec6323725.slice/crio-19098ae7d4eb3e645af2cbc5f2d9419577fe23e63ada5fa06f940a733b6b9602 WatchSource:0}: Error finding container 19098ae7d4eb3e645af2cbc5f2d9419577fe23e63ada5fa06f940a733b6b9602: Status 404 returned error can't find the container with id 19098ae7d4eb3e645af2cbc5f2d9419577fe23e63ada5fa06f940a733b6b9602
May 28 07:18:42.831966 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.831932    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns"]
May 28 07:18:42.835886 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:42.835849    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46cbd6a3_ca2c_47fe_8455_098baf850501.slice/crio-4e10afdf3457833f0f5ba7f9bc97067a29e9de77ac693822ab3cb8e0599b53e3 WatchSource:0}: Error finding container 4e10afdf3457833f0f5ba7f9bc97067a29e9de77ac693822ab3cb8e0599b53e3: Status 404 returned error can't find the container with id 4e10afdf3457833f0f5ba7f9bc97067a29e9de77ac693822ab3cb8e0599b53e3
May 28 07:18:42.910494 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910494 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910654 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910504    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910654 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910654 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910654 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfg2\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910713    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910729    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:42.910958 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:42.910797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.011947    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012009    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012035    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfg2\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012067    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012099    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012127    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012170    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012203    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012232    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.013039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012273    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.014296 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012320    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.014296 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.013915    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.014296 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.013957    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.014998 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.013451    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.014998 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.012745    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.017452 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.017424    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.017668 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.017641    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.017733 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.017696    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.017905 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.017880    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.018767 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.018234    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.018767 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.018716    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.019214 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.019190    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.019286 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.019259    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.020261 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.020242    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.021270 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.021243    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfg2\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.021463 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.021439    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.109927 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.109895    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:18:43.276048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.276009    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qr82" event={"ID":"de63b126-71a8-48ca-88a3-57ed85e0c70f","Type":"ContainerStarted","Data":"5e7071e83996eb015fb825e089c0be4d19e5fee9440e3842ea1e1ac5878b4e80"}
May 28 07:18:43.277285 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.277252    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns" event={"ID":"46cbd6a3-ca2c-47fe-8455-098baf850501","Type":"ContainerStarted","Data":"4e10afdf3457833f0f5ba7f9bc97067a29e9de77ac693822ab3cb8e0599b53e3"}
May 28 07:18:43.279242 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.279210    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6" event={"ID":"b60e2eac-1c0a-4b98-aa5c-463ec6323725","Type":"ContainerStarted","Data":"f59f4179082bf06d2c0c1d836b1cf011087b98b0e6a3db41a965e83d557215a9"}
May 28 07:18:43.279381 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.279250    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6" event={"ID":"b60e2eac-1c0a-4b98-aa5c-463ec6323725","Type":"ContainerStarted","Data":"bf555859a1b7ec169853913b553fa029850035f39e3f022fea23f364e90110d7"}
May 28 07:18:43.279381 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.279268    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6" event={"ID":"b60e2eac-1c0a-4b98-aa5c-463ec6323725","Type":"ContainerStarted","Data":"19098ae7d4eb3e645af2cbc5f2d9419577fe23e63ada5fa06f940a733b6b9602"}
May 28 07:18:43.309214 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:43.307865    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:18:43.327680 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:43.327620    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd645ba9_c02e_4f7e_80e5_677556aabe8f.slice/crio-7a823f703939fad585d0ee1dd4bf585a0ca1a6abd07e6927c25d9d5392c5a5a6 WatchSource:0}: Error finding container 7a823f703939fad585d0ee1dd4bf585a0ca1a6abd07e6927c25d9d5392c5a5a6: Status 404 returned error can't find the container with id 7a823f703939fad585d0ee1dd4bf585a0ca1a6abd07e6927c25d9d5392c5a5a6
May 28 07:18:44.251123 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:44.251096    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8szw5"
May 28 07:18:44.284788 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:44.284750    2570 generic.go:358] "Generic (PLEG): container finished" podID="de63b126-71a8-48ca-88a3-57ed85e0c70f" containerID="5e7071e83996eb015fb825e089c0be4d19e5fee9440e3842ea1e1ac5878b4e80" exitCode=0
May 28 07:18:44.284977 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:44.284842    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qr82" event={"ID":"de63b126-71a8-48ca-88a3-57ed85e0c70f","Type":"ContainerDied","Data":"5e7071e83996eb015fb825e089c0be4d19e5fee9440e3842ea1e1ac5878b4e80"}
May 28 07:18:44.287047 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:44.287008    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"7a823f703939fad585d0ee1dd4bf585a0ca1a6abd07e6927c25d9d5392c5a5a6"}
May 28 07:18:45.292462 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.292424    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns" event={"ID":"46cbd6a3-ca2c-47fe-8455-098baf850501","Type":"ContainerStarted","Data":"ab4d4a63f86c97e7e87fc85c7105433d05fc52cdbf2d1693af15ccda6d92fa07"}
May 28 07:18:45.292894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.292473    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns" event={"ID":"46cbd6a3-ca2c-47fe-8455-098baf850501","Type":"ContainerStarted","Data":"f034136425bbfd888f97b5c069bcb7ce5f8cf9a964f4ab1460d0c89c4bb5c41e"}
May 28 07:18:45.292894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.292486    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns" event={"ID":"46cbd6a3-ca2c-47fe-8455-098baf850501","Type":"ContainerStarted","Data":"c6c70c385bf4fdb9361c227a903f04bc85a3cd8c61c93a71cde1dd95e650c176"}
May 28 07:18:45.293785 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.293760    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411" exitCode=0
May 28 07:18:45.293918 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.293854    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411"}
May 28 07:18:45.295914 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.295890    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6" event={"ID":"b60e2eac-1c0a-4b98-aa5c-463ec6323725","Type":"ContainerStarted","Data":"ae131852505dc81ac56bcb316849a834affe56e001f32a19018d06b623b7c6a4"}
May 28 07:18:45.297882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.297861    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qr82" event={"ID":"de63b126-71a8-48ca-88a3-57ed85e0c70f","Type":"ContainerStarted","Data":"8d8da489a359f0a72f4bbedc6db4e5333719fc0cdfd3a660a71bc2f74e2a8fad"}
May 28 07:18:45.297882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.297890    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qr82" event={"ID":"de63b126-71a8-48ca-88a3-57ed85e0c70f","Type":"ContainerStarted","Data":"1ede0cb4149ede12146135dac10c2cf6cff169ed79c7c9e5389d72006dfe475d"}
May 28 07:18:45.313425 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.313370    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gzdns" podStartSLOduration=2.945014696 podStartE2EDuration="4.313355348s" podCreationTimestamp="2026-05-28 07:18:41 +0000 UTC" firstStartedPulling="2026-05-28 07:18:42.838057102 +0000 UTC m=+111.566963829" lastFinishedPulling="2026-05-28 07:18:44.206397766 +0000 UTC m=+112.935304481" observedRunningTime="2026-05-28 07:18:45.312223933 +0000 UTC m=+114.041130668" watchObservedRunningTime="2026-05-28 07:18:45.313355348 +0000 UTC m=+114.042262083"
May 28 07:18:45.334490 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.334429    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xkll6" podStartSLOduration=2.65066654 podStartE2EDuration="4.334413643s" podCreationTimestamp="2026-05-28 07:18:41 +0000 UTC" firstStartedPulling="2026-05-28 07:18:43.171660186 +0000 UTC m=+111.900566898" lastFinishedPulling="2026-05-28 07:18:44.855407275 +0000 UTC m=+113.584314001" observedRunningTime="2026-05-28 07:18:45.333747926 +0000 UTC m=+114.062654672" watchObservedRunningTime="2026-05-28 07:18:45.334413643 +0000 UTC m=+114.063320377"
May 28 07:18:45.342129 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.342104    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:45.351704 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:45.351641    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7qr82" podStartSLOduration=3.304372961 podStartE2EDuration="4.351626705s" podCreationTimestamp="2026-05-28 07:18:41 +0000 UTC" firstStartedPulling="2026-05-28 07:18:42.077908575 +0000 UTC m=+110.806815287" lastFinishedPulling="2026-05-28 07:18:43.125162316 +0000 UTC m=+111.854069031" observedRunningTime="2026-05-28 07:18:45.350579074 +0000 UTC m=+114.079485808" watchObservedRunningTime="2026-05-28 07:18:45.351626705 +0000 UTC m=+114.080533439"
May 28 07:18:46.022467 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.022427    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55b9b594dc-h9lvm"]
May 28 07:18:46.024593 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.024575    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.027319 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.027292    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 07:18:46.028233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.028213    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 07:18:46.028356 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.028263    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-65obdodvt1dlm\""
May 28 07:18:46.028428 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.028368    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2ngq4\""
May 28 07:18:46.028428 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.028421    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 07:18:46.028557 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.028502    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 07:18:46.034194 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.034170    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b9b594dc-h9lvm"]
May 28 07:18:46.042551 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042656 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-client-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042656 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/87a0acde-0daf-4f78-acee-607a6d42fd54-audit-log\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042729 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-tls\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042729 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042719    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-client-certs\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042785 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmgr\" (UniqueName: \"kubernetes.io/projected/87a0acde-0daf-4f78-acee-607a6d42fd54-kube-api-access-ctmgr\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.042814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.042799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-metrics-server-audit-profiles\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144028 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.143984    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-metrics-server-audit-profiles\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144053    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144088    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-client-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144123    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/87a0acde-0daf-4f78-acee-607a6d42fd54-audit-log\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144174    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-tls\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144213    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-client-certs\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144523 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144253    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmgr\" (UniqueName: \"kubernetes.io/projected/87a0acde-0daf-4f78-acee-607a6d42fd54-kube-api-access-ctmgr\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.144886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.144857    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.145086 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.145011    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/87a0acde-0daf-4f78-acee-607a6d42fd54-audit-log\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.145086 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.145062    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/87a0acde-0daf-4f78-acee-607a6d42fd54-metrics-server-audit-profiles\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.147237 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.147211    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-client-certs\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.147348 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.147259    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-secret-metrics-server-tls\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.147410 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.147388    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a0acde-0daf-4f78-acee-607a6d42fd54-client-ca-bundle\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.155038 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.155016    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmgr\" (UniqueName: \"kubernetes.io/projected/87a0acde-0daf-4f78-acee-607a6d42fd54-kube-api-access-ctmgr\") pod \"metrics-server-55b9b594dc-h9lvm\" (UID: \"87a0acde-0daf-4f78-acee-607a6d42fd54\") " pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.335125 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.335088    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:18:46.487535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:46.487501    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b9b594dc-h9lvm"]
May 28 07:18:46.838859 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:46.838822    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a0acde_0daf_4f78_acee_607a6d42fd54.slice/crio-992cff52c6f834bf91bc4e79916b1d617ef25e74c81698fe169cde67367f639b WatchSource:0}: Error finding container 992cff52c6f834bf91bc4e79916b1d617ef25e74c81698fe169cde67367f639b: Status 404 returned error can't find the container with id 992cff52c6f834bf91bc4e79916b1d617ef25e74c81698fe169cde67367f639b
May 28 07:18:47.307683 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.307650    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"}
May 28 07:18:47.307683 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.307689    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"}
May 28 07:18:47.307982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.307700    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"}
May 28 07:18:47.307982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.307709    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"}
May 28 07:18:47.307982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.307717    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"}
May 28 07:18:47.309181 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:47.309135    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm" event={"ID":"87a0acde-0daf-4f78-acee-607a6d42fd54","Type":"ContainerStarted","Data":"992cff52c6f834bf91bc4e79916b1d617ef25e74c81698fe169cde67367f639b"}
May 28 07:18:48.316310 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:48.316278    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerStarted","Data":"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"}
May 28 07:18:48.317925 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:48.317888    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm" event={"ID":"87a0acde-0daf-4f78-acee-607a6d42fd54","Type":"ContainerStarted","Data":"31c55dc300ac7d6b6ffe13e822d487d82f37fcac836aae15c2101a180fa1cf41"}
May 28 07:18:48.345046 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:48.344995    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.436252842 podStartE2EDuration="6.344980985s" podCreationTimestamp="2026-05-28 07:18:42 +0000 UTC" firstStartedPulling="2026-05-28 07:18:43.330157223 +0000 UTC m=+112.059063934" lastFinishedPulling="2026-05-28 07:18:48.238885351 +0000 UTC m=+116.967792077" observedRunningTime="2026-05-28 07:18:48.342805737 +0000 UTC m=+117.071712471" watchObservedRunningTime="2026-05-28 07:18:48.344980985 +0000 UTC m=+117.073887720"
May 28 07:18:50.357509 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.357444    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerName="registry" containerID="cri-o://66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e" gracePeriod=30
May 28 07:18:50.602068 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.602029    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:50.623271 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.623151    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm" podStartSLOduration=3.222648385 podStartE2EDuration="4.623129535s" podCreationTimestamp="2026-05-28 07:18:46 +0000 UTC" firstStartedPulling="2026-05-28 07:18:46.84103703 +0000 UTC m=+115.569943742" lastFinishedPulling="2026-05-28 07:18:48.241518181 +0000 UTC m=+116.970424892" observedRunningTime="2026-05-28 07:18:48.363580777 +0000 UTC m=+117.092487508" watchObservedRunningTime="2026-05-28 07:18:50.623129535 +0000 UTC m=+119.352036271"
May 28 07:18:50.685921 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.685890    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.685954    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.685988    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686009    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686047    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686088    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686115 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686109    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vbj9\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686461 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686130    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration\") pod \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\" (UID: \"46d6acc7-bb13-4ada-b484-84bf3d21b89b\") "
May 28 07:18:50.686539 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686512    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:18:50.686819 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.686777    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:18:50.689106 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.689077    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:18:50.689211 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.689105    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:18:50.689211 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.689199    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9" (OuterVolumeSpecName: "kube-api-access-8vbj9") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "kube-api-access-8vbj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:18:50.689531 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.689508    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:18:50.689616 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.689533    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:18:50.695209 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.695185    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "46d6acc7-bb13-4ada-b484-84bf3d21b89b" (UID: "46d6acc7-bb13-4ada-b484-84bf3d21b89b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:18:50.787626 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787577    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-trusted-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787626 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787621    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-certificates\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787626 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787633    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vbj9\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-kube-api-access-8vbj9\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787626 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787643    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-image-registry-private-configuration\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787653    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46d6acc7-bb13-4ada-b484-84bf3d21b89b-ca-trust-extracted\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787662    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-bound-sa-token\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787671    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46d6acc7-bb13-4ada-b484-84bf3d21b89b-installation-pull-secrets\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:50.787891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:50.787679    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46d6acc7-bb13-4ada-b484-84bf3d21b89b-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:18:51.327961 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.327920    2570 generic.go:358] "Generic (PLEG): container finished" podID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerID="66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e" exitCode=0
May 28 07:18:51.328156 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.327983    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" event={"ID":"46d6acc7-bb13-4ada-b484-84bf3d21b89b","Type":"ContainerDied","Data":"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"}
May 28 07:18:51.328156 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.328006    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j"
May 28 07:18:51.328156 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.328018    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b468cb5f7-xgf4j" event={"ID":"46d6acc7-bb13-4ada-b484-84bf3d21b89b","Type":"ContainerDied","Data":"b0fb534586b26e9e91f3e9edec7f783a677aa1b7e87a3a0fa3fa290f42e00438"}
May 28 07:18:51.328156 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.328039    2570 scope.go:117] "RemoveContainer" containerID="66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"
May 28 07:18:51.337247 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.337227    2570 scope.go:117] "RemoveContainer" containerID="66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"
May 28 07:18:51.337535 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:18:51.337514    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e\": container with ID starting with 66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e not found: ID does not exist" containerID="66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"
May 28 07:18:51.337613 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.337559    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e"} err="failed to get container status \"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e\": rpc error: code = NotFound desc = could not find container \"66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e\": container with ID starting with 66c1e81a04ca961cf1cfb6b9a92ff4737948ef33480cc3f03a9afb6b48230d1e not found: ID does not exist"
May 28 07:18:51.348352 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.348313    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:18:51.353273 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.353248    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b468cb5f7-xgf4j"]
May 28 07:18:51.877523 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:51.877489    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" path="/var/lib/kubelet/pods/46d6acc7-bb13-4ada-b484-84bf3d21b89b/volumes"
May 28 07:18:57.354169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.354133    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-xcjhs"]
May 28 07:18:57.354575 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.354460    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerName="registry"
May 28 07:18:57.354575 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.354471    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerName="registry"
May 28 07:18:57.354575 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.354518    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="46d6acc7-bb13-4ada-b484-84bf3d21b89b" containerName="registry"
May 28 07:18:57.359969 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.359949    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:18:57.362417 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.362391    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vlws8\""
May 28 07:18:57.362558 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.362449    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 07:18:57.362558 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.362510    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 07:18:57.365489 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.365458    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-xcjhs"]
May 28 07:18:57.448431 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.448393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mfn\" (UniqueName: \"kubernetes.io/projected/5b83670d-3936-4008-a9ad-1791126fb088-kube-api-access-c7mfn\") pod \"downloads-57bd96b888-xcjhs\" (UID: \"5b83670d-3936-4008-a9ad-1791126fb088\") " pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:18:57.549793 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.549748    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mfn\" (UniqueName: \"kubernetes.io/projected/5b83670d-3936-4008-a9ad-1791126fb088-kube-api-access-c7mfn\") pod \"downloads-57bd96b888-xcjhs\" (UID: \"5b83670d-3936-4008-a9ad-1791126fb088\") " pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:18:57.559077 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.559042    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mfn\" (UniqueName: \"kubernetes.io/projected/5b83670d-3936-4008-a9ad-1791126fb088-kube-api-access-c7mfn\") pod \"downloads-57bd96b888-xcjhs\" (UID: \"5b83670d-3936-4008-a9ad-1791126fb088\") " pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:18:57.670003 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.669918    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:18:57.819617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:57.819582    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-xcjhs"]
May 28 07:18:57.823433 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:18:57.823406    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b83670d_3936_4008_a9ad_1791126fb088.slice/crio-44a0732d291178742c9ff805a044c71f71d99c720cbbfb893373b853429fcefa WatchSource:0}: Error finding container 44a0732d291178742c9ff805a044c71f71d99c720cbbfb893373b853429fcefa: Status 404 returned error can't find the container with id 44a0732d291178742c9ff805a044c71f71d99c720cbbfb893373b853429fcefa
May 28 07:18:58.350593 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:18:58.350550    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-xcjhs" event={"ID":"5b83670d-3936-4008-a9ad-1791126fb088","Type":"ContainerStarted","Data":"44a0732d291178742c9ff805a044c71f71d99c720cbbfb893373b853429fcefa"}
May 28 07:19:01.586389 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:01.586350    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:19:01.589275 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:01.589232    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3d00dbf-6569-4d01-9db6-3eb65903a4e7-metrics-certs\") pod \"network-metrics-daemon-48cgt\" (UID: \"a3d00dbf-6569-4d01-9db6-3eb65903a4e7\") " pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:19:01.594644 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:01.594606    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vdkv\""
May 28 07:19:01.602878 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:01.602854    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48cgt"
May 28 07:19:01.756464 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:01.756425    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48cgt"]
May 28 07:19:01.759981 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:19:01.759936    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d00dbf_6569_4d01_9db6_3eb65903a4e7.slice/crio-7623ed09d6a54222b6fc3758147d0e1d1d94f1e9aebbd82b026d27de9779e700 WatchSource:0}: Error finding container 7623ed09d6a54222b6fc3758147d0e1d1d94f1e9aebbd82b026d27de9779e700: Status 404 returned error can't find the container with id 7623ed09d6a54222b6fc3758147d0e1d1d94f1e9aebbd82b026d27de9779e700
May 28 07:19:02.363460 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:02.363420    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48cgt" event={"ID":"a3d00dbf-6569-4d01-9db6-3eb65903a4e7","Type":"ContainerStarted","Data":"7623ed09d6a54222b6fc3758147d0e1d1d94f1e9aebbd82b026d27de9779e700"}
May 28 07:19:03.367458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:03.367414    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48cgt" event={"ID":"a3d00dbf-6569-4d01-9db6-3eb65903a4e7","Type":"ContainerStarted","Data":"9905e940c8dc6d9b92a728bd11138903929cc8928010acfcf062a8a2dc1ef576"}
May 28 07:19:03.367882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:03.367456    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48cgt" event={"ID":"a3d00dbf-6569-4d01-9db6-3eb65903a4e7","Type":"ContainerStarted","Data":"643a7eee2effa71444e555c83736fe3559135d7ade73cbf35f3d5c742494f41d"}
May 28 07:19:03.384249 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:03.384190    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-48cgt" podStartSLOduration=130.294460443 podStartE2EDuration="2m11.384172891s" podCreationTimestamp="2026-05-28 07:16:52 +0000 UTC" firstStartedPulling="2026-05-28 07:19:01.762351033 +0000 UTC m=+130.491257759" lastFinishedPulling="2026-05-28 07:19:02.852063495 +0000 UTC m=+131.580970207" observedRunningTime="2026-05-28 07:19:03.38347648 +0000 UTC m=+132.112383401" watchObservedRunningTime="2026-05-28 07:19:03.384172891 +0000 UTC m=+132.113079625"
May 28 07:19:06.336084 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:06.336047    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:19:06.336541 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:06.336103    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:19:07.474543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.474501    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:07.478151 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.478128    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482011    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9kxvz\""
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482083    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482110    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482011    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482013    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 07:19:07.482453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.482310    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 07:19:07.486525 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.486500    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:07.542938 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.542894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.543118 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.543004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.543118 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.543082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.543218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.543116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtg2\" (UniqueName: \"kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.543218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.543144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.543218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.543179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644400 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644320    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644421    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644462    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtg2\" (UniqueName: \"kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644489    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644523    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.644617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.644566    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.645124 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.645095    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.645452 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.645122    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.645452 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.645154    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.647084 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.647054    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.647240 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.647222    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.652158 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.652134    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtg2\" (UniqueName: \"kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2\") pod \"console-685c996db9-vgk92\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") " pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.789402 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.789361    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:07.934497 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:07.934463    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:07.937568 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:19:07.937529    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ba2793_af8d_4cdf_833e_606b02d71d3d.slice/crio-5e887e46975b00a7f6fb17db6e3481bbdf47a1cd6cf5983b6ac6b9c1c630460e WatchSource:0}: Error finding container 5e887e46975b00a7f6fb17db6e3481bbdf47a1cd6cf5983b6ac6b9c1c630460e: Status 404 returned error can't find the container with id 5e887e46975b00a7f6fb17db6e3481bbdf47a1cd6cf5983b6ac6b9c1c630460e
May 28 07:19:08.386229 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:08.386192    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c996db9-vgk92" event={"ID":"d4ba2793-af8d-4cdf-833e-606b02d71d3d","Type":"ContainerStarted","Data":"5e887e46975b00a7f6fb17db6e3481bbdf47a1cd6cf5983b6ac6b9c1c630460e"}
May 28 07:19:10.310870 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:10.310832    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q766_5ad0fd15-20a2-44fc-969d-0468e04b4bdc/serve-healthcheck-canary/0.log"
May 28 07:19:12.400971 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:12.400914    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c996db9-vgk92" event={"ID":"d4ba2793-af8d-4cdf-833e-606b02d71d3d","Type":"ContainerStarted","Data":"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"}
May 28 07:19:12.423615 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:12.423553    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-685c996db9-vgk92" podStartSLOduration=2.017006572 podStartE2EDuration="5.423534579s" podCreationTimestamp="2026-05-28 07:19:07 +0000 UTC" firstStartedPulling="2026-05-28 07:19:07.939948273 +0000 UTC m=+136.668855000" lastFinishedPulling="2026-05-28 07:19:11.346476292 +0000 UTC m=+140.075383007" observedRunningTime="2026-05-28 07:19:12.422869766 +0000 UTC m=+141.151776501" watchObservedRunningTime="2026-05-28 07:19:12.423534579 +0000 UTC m=+141.152441314"
May 28 07:19:15.855802 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:15.855766    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:19:15.862009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:15.861982    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:15.869963 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:15.869926    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:19:15.871983 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:15.871685    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 07:19:16.021121 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021297 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021297 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021386    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.021418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.021405    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmpn\" (UniqueName: \"kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122032 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.121940    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122030    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122066    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122097    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122126    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122187 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122161    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.122434 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.122188    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmpn\" (UniqueName: \"kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.123432 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.123400    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.124109 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.124077    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.128600 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.125319    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.128600 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.125400    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.129510 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.129486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.129754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.129730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.133850 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.133827    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmpn\" (UniqueName: \"kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn\") pod \"console-5f7df496df-bdk44\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") " pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:16.176975 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:16.176926    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:17.789526 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:17.789486    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:17.789917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:17.789542    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:17.795563 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:17.795537    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:18.425053 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:18.425016    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:18.923301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:18.923277    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:19:18.925625 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:19:18.925598    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de14904_366b_4c38_887b_84f9bfd966d9.slice/crio-7f68984db17ad6bc8bd25ea0bf37b99ef80f6888743c561ad585a93dd2610cb4 WatchSource:0}: Error finding container 7f68984db17ad6bc8bd25ea0bf37b99ef80f6888743c561ad585a93dd2610cb4: Status 404 returned error can't find the container with id 7f68984db17ad6bc8bd25ea0bf37b99ef80f6888743c561ad585a93dd2610cb4
May 28 07:19:19.425374 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.425316    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-xcjhs" event={"ID":"5b83670d-3936-4008-a9ad-1791126fb088","Type":"ContainerStarted","Data":"4fef6c37c21b2a34fc70e45d2627dc7ed1031ca195df9a9773dc5c0cbca8f186"}
May 28 07:19:19.426078 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.426047    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:19:19.428313 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.428270    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7df496df-bdk44" event={"ID":"3de14904-366b-4c38-887b-84f9bfd966d9","Type":"ContainerStarted","Data":"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"}
May 28 07:19:19.428465 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.428348    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7df496df-bdk44" event={"ID":"3de14904-366b-4c38-887b-84f9bfd966d9","Type":"ContainerStarted","Data":"7f68984db17ad6bc8bd25ea0bf37b99ef80f6888743c561ad585a93dd2610cb4"}
May 28 07:19:19.441039 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.440987    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-xcjhs"
May 28 07:19:19.447574 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.447517    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-xcjhs" podStartSLOduration=1.400590336 podStartE2EDuration="22.447503648s" podCreationTimestamp="2026-05-28 07:18:57 +0000 UTC" firstStartedPulling="2026-05-28 07:18:57.825815346 +0000 UTC m=+126.554722075" lastFinishedPulling="2026-05-28 07:19:18.872728671 +0000 UTC m=+147.601635387" observedRunningTime="2026-05-28 07:19:19.445552653 +0000 UTC m=+148.174459388" watchObservedRunningTime="2026-05-28 07:19:19.447503648 +0000 UTC m=+148.176410381"
May 28 07:19:19.464127 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:19.464063    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f7df496df-bdk44" podStartSLOduration=4.464045733 podStartE2EDuration="4.464045733s" podCreationTimestamp="2026-05-28 07:19:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:19:19.461541731 +0000 UTC m=+148.190448466" watchObservedRunningTime="2026-05-28 07:19:19.464045733 +0000 UTC m=+148.192952469"
May 28 07:19:26.177325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.177286    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:26.177325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.177347    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:26.183102 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.183072    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:26.342741 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.342706    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:19:26.347551 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.347522    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55b9b594dc-h9lvm"
May 28 07:19:26.459241 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.459162    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:19:26.504485 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:26.504449    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:29.466658 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:29.466615    2570 generic.go:358] "Generic (PLEG): container finished" podID="f12fdcfa-f4d1-4ec2-a58e-4d739410538f" containerID="7d52fb167bf8cce67c7b021e4248f2a7ff8963e515f125d2e94dc7d0c6c9c01d" exitCode=0
May 28 07:19:29.467127 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:29.466686    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs" event={"ID":"f12fdcfa-f4d1-4ec2-a58e-4d739410538f","Type":"ContainerDied","Data":"7d52fb167bf8cce67c7b021e4248f2a7ff8963e515f125d2e94dc7d0c6c9c01d"}
May 28 07:19:29.467127 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:29.467059    2570 scope.go:117] "RemoveContainer" containerID="7d52fb167bf8cce67c7b021e4248f2a7ff8963e515f125d2e94dc7d0c6c9c01d"
May 28 07:19:30.471468 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:30.471376    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-fxlzs" event={"ID":"f12fdcfa-f4d1-4ec2-a58e-4d739410538f","Type":"ContainerStarted","Data":"29ccf8788233ce9377c9565c6e2e5a3ddf678c194e7398f5ba04b689bb46fc25"}
May 28 07:19:51.529570 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.529452    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-685c996db9-vgk92" podUID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" containerName="console" containerID="cri-o://17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506" gracePeriod=15
May 28 07:19:51.806001 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.805975    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-685c996db9-vgk92_d4ba2793-af8d-4cdf-833e-606b02d71d3d/console/0.log"
May 28 07:19:51.806143 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.806042    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:51.947024 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.946986    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947232 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947063    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947232 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947089    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947232 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947109    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dtg2\" (UniqueName: \"kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947232 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947133    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947232 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947188    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert\") pod \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\" (UID: \"d4ba2793-af8d-4cdf-833e-606b02d71d3d\") "
May 28 07:19:51.947630 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947603    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config" (OuterVolumeSpecName: "console-config") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:19:51.947714 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947692    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:19:51.947766 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.947694    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:19:51.949717 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.949680    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:19:51.949821 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.949729    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:19:51.949821 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:51.949763    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2" (OuterVolumeSpecName: "kube-api-access-9dtg2") pod "d4ba2793-af8d-4cdf-833e-606b02d71d3d" (UID: "d4ba2793-af8d-4cdf-833e-606b02d71d3d"). InnerVolumeSpecName "kube-api-access-9dtg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048103    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-oauth-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048140    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-service-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048150    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dtg2\" (UniqueName: \"kubernetes.io/projected/d4ba2793-af8d-4cdf-833e-606b02d71d3d-kube-api-access-9dtg2\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048160    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-oauth-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048169    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.048201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.048179    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ba2793-af8d-4cdf-833e-606b02d71d3d-console-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:19:52.543370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543309    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-685c996db9-vgk92_d4ba2793-af8d-4cdf-833e-606b02d71d3d/console/0.log"
May 28 07:19:52.543796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543388    2570 generic.go:358] "Generic (PLEG): container finished" podID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" containerID="17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506" exitCode=2
May 28 07:19:52.543796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543450    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c996db9-vgk92"
May 28 07:19:52.543796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543474    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c996db9-vgk92" event={"ID":"d4ba2793-af8d-4cdf-833e-606b02d71d3d","Type":"ContainerDied","Data":"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"}
May 28 07:19:52.543796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543508    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c996db9-vgk92" event={"ID":"d4ba2793-af8d-4cdf-833e-606b02d71d3d","Type":"ContainerDied","Data":"5e887e46975b00a7f6fb17db6e3481bbdf47a1cd6cf5983b6ac6b9c1c630460e"}
May 28 07:19:52.543796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.543524    2570 scope.go:117] "RemoveContainer" containerID="17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"
May 28 07:19:52.557817 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.557796    2570 scope.go:117] "RemoveContainer" containerID="17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"
May 28 07:19:52.558089 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:19:52.558066    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506\": container with ID starting with 17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506 not found: ID does not exist" containerID="17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"
May 28 07:19:52.558144 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.558101    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506"} err="failed to get container status \"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506\": rpc error: code = NotFound desc = could not find container \"17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506\": container with ID starting with 17c7e74a4677fac059c94220580fd4fd1186209d9050c39860154357961cf506 not found: ID does not exist"
May 28 07:19:52.567960 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.567932    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:52.570927 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:52.570904    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-685c996db9-vgk92"]
May 28 07:19:53.877631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:19:53.877594    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" path="/var/lib/kubelet/pods/d4ba2793-af8d-4cdf-833e-606b02d71d3d/volumes"
May 28 07:20:02.010017 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.009980    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:02.010538 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010460    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="alertmanager" containerID="cri-o://9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b" gracePeriod=120
May 28 07:20:02.010538 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010501    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy" containerID="cri-o://2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a" gracePeriod=120
May 28 07:20:02.010538 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010509    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-web" containerID="cri-o://4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3" gracePeriod=120
May 28 07:20:02.010715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010509    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="prom-label-proxy" containerID="cri-o://a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93" gracePeriod=120
May 28 07:20:02.010715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010593    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="config-reloader" containerID="cri-o://e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a" gracePeriod=120
May 28 07:20:02.010715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.010613    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-metric" containerID="cri-o://9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc" gracePeriod=120
May 28 07:20:02.574682 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574638    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93" exitCode=0
May 28 07:20:02.574682 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574671    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc" exitCode=0
May 28 07:20:02.574682 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574678    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a" exitCode=0
May 28 07:20:02.574682 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574684    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a" exitCode=0
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574695    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b" exitCode=0
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574709    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"}
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574746    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"}
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574756    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"}
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574767    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"}
May 28 07:20:02.574947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:02.574776    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"}
May 28 07:20:03.277788 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.277764    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.444692 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444573    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.444692 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444678    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwfg2\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.444908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444702    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.444908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444726    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.444908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444764    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445057 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.444909    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445057 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445013    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445250    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:20:03.445487 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445299    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445487 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445361    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445487 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445401    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445487 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445426    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445707 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445491    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445707 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445514    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca\") pod \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\" (UID: \"cd645ba9-c02e-4f7e-80e5-677556aabe8f\") "
May 28 07:20:03.445707 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445601    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:03.445850 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445774    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-main-db\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.445850 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.445795    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.446219 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.446096    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:03.448144 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.447845    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2" (OuterVolumeSpecName: "kube-api-access-pwfg2") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "kube-api-access-pwfg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:20:03.448144 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.447976    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.448144 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.447979    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out" (OuterVolumeSpecName: "config-out") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:20:03.448324 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.448218    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.448791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.448766    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.448998 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.448978    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume" (OuterVolumeSpecName: "config-volume") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.449946 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.449920    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.450492 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.450472    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:20:03.452549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.452526    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.459216 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.459191    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config" (OuterVolumeSpecName: "web-config") pod "cd645ba9-c02e-4f7e-80e5-677556aabe8f" (UID: "cd645ba9-c02e-4f7e-80e5-677556aabe8f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:03.546815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546773    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-main-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.546815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546810    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-cluster-tls-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.546815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546822    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546833    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-tls-assets\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546842    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546851    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-web-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546860    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-volume\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546881    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd645ba9-c02e-4f7e-80e5-677556aabe8f-metrics-client-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546890    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd645ba9-c02e-4f7e-80e5-677556aabe8f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546900    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwfg2\" (UniqueName: \"kubernetes.io/projected/cd645ba9-c02e-4f7e-80e5-677556aabe8f-kube-api-access-pwfg2\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.547101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.546909    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd645ba9-c02e-4f7e-80e5-677556aabe8f-config-out\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:03.581030 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.580992    2570 generic.go:358] "Generic (PLEG): container finished" podID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerID="4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3" exitCode=0
May 28 07:20:03.581186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.581081    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"}
May 28 07:20:03.581186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.581124    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd645ba9-c02e-4f7e-80e5-677556aabe8f","Type":"ContainerDied","Data":"7a823f703939fad585d0ee1dd4bf585a0ca1a6abd07e6927c25d9d5392c5a5a6"}
May 28 07:20:03.581186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.581132    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.581186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.581142    2570 scope.go:117] "RemoveContainer" containerID="a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"
May 28 07:20:03.589613 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.589589    2570 scope.go:117] "RemoveContainer" containerID="9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"
May 28 07:20:03.596931 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.596912    2570 scope.go:117] "RemoveContainer" containerID="2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"
May 28 07:20:03.604932 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.604912    2570 scope.go:117] "RemoveContainer" containerID="4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"
May 28 07:20:03.605250 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.605230    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:03.609885 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.609852    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:03.612925 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.612903    2570 scope.go:117] "RemoveContainer" containerID="e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"
May 28 07:20:03.619985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.619961    2570 scope.go:117] "RemoveContainer" containerID="9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"
May 28 07:20:03.628113 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.628091    2570 scope.go:117] "RemoveContainer" containerID="257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411"
May 28 07:20:03.634905 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.634887    2570 scope.go:117] "RemoveContainer" containerID="a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"
May 28 07:20:03.635127 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.635104    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93\": container with ID starting with a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93 not found: ID does not exist" containerID="a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"
May 28 07:20:03.635220 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.635134    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93"} err="failed to get container status \"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93\": rpc error: code = NotFound desc = could not find container \"a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93\": container with ID starting with a4cfb7dc759ca018d43cefc757015cf3f73971a9ce7f5f4ede92d5cc414b0a93 not found: ID does not exist"
May 28 07:20:03.635220 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.635155    2570 scope.go:117] "RemoveContainer" containerID="9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"
May 28 07:20:03.635549 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.635523    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc\": container with ID starting with 9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc not found: ID does not exist" containerID="9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"
May 28 07:20:03.635685 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.635555    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc"} err="failed to get container status \"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc\": rpc error: code = NotFound desc = could not find container \"9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc\": container with ID starting with 9d9e101cde7172fde8f98b80a4942cf5a84ad5de12dba119342336a37d92ddcc not found: ID does not exist"
May 28 07:20:03.635685 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.635596    2570 scope.go:117] "RemoveContainer" containerID="2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"
May 28 07:20:03.636377 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.636322    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a\": container with ID starting with 2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a not found: ID does not exist" containerID="2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"
May 28 07:20:03.636498 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.636385    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a"} err="failed to get container status \"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a\": rpc error: code = NotFound desc = could not find container \"2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a\": container with ID starting with 2954eefbf032d9c736e7a1f6ed3970d876d4ae17444eb7d5df9d3b907efd455a not found: ID does not exist"
May 28 07:20:03.636498 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.636408    2570 scope.go:117] "RemoveContainer" containerID="4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"
May 28 07:20:03.636698 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.636668    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3\": container with ID starting with 4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3 not found: ID does not exist" containerID="4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"
May 28 07:20:03.636770 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.636698    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3"} err="failed to get container status \"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3\": rpc error: code = NotFound desc = could not find container \"4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3\": container with ID starting with 4ad26029474bcf709e7d95d3f3f128b5fdaa46d90f914e884f8db165551090e3 not found: ID does not exist"
May 28 07:20:03.636770 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.636721    2570 scope.go:117] "RemoveContainer" containerID="e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"
May 28 07:20:03.637141 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.637117    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a\": container with ID starting with e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a not found: ID does not exist" containerID="e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"
May 28 07:20:03.637238 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637149    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a"} err="failed to get container status \"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a\": rpc error: code = NotFound desc = could not find container \"e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a\": container with ID starting with e5c9e9ed1b5b10af95243aadc27165b1912586ea7165eb57cd317d4c3679196a not found: ID does not exist"
May 28 07:20:03.637238 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637174    2570 scope.go:117] "RemoveContainer" containerID="9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"
May 28 07:20:03.637457 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.637440    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b\": container with ID starting with 9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b not found: ID does not exist" containerID="9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"
May 28 07:20:03.637520 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637462    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b"} err="failed to get container status \"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b\": rpc error: code = NotFound desc = could not find container \"9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b\": container with ID starting with 9f27e887fb0cc11da8228b7b93caf8bff79b4b5033453415fdb68020e49b096b not found: ID does not exist"
May 28 07:20:03.637520 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637481    2570 scope.go:117] "RemoveContainer" containerID="257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411"
May 28 07:20:03.637740 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:03.637719    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411\": container with ID starting with 257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411 not found: ID does not exist" containerID="257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411"
May 28 07:20:03.637844 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637743    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411"} err="failed to get container status \"257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411\": rpc error: code = NotFound desc = could not find container \"257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411\": container with ID starting with 257c910dfb4dfbd5acbe243f0a1b1af716a7b8c8f7f5c65a516ff145e6e18411 not found: ID does not exist"
May 28 07:20:03.637909 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.637897    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:03.638301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638286    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-web"
May 28 07:20:03.638301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638303    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-web"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638312    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="prom-label-proxy"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638318    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="prom-label-proxy"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638350    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638355    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638368    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="alertmanager"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638373    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="alertmanager"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638380    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-metric"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638385    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-metric"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638395    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="init-config-reloader"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638400    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="init-config-reloader"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638407    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" containerName="console"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638412    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" containerName="console"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638419    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="config-reloader"
May 28 07:20:03.638423 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638424    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="config-reloader"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638489    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-metric"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638499    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="alertmanager"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638505    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="config-reloader"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638512    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638517    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="prom-label-proxy"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638523    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" containerName="kube-rbac-proxy-web"
May 28 07:20:03.638815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.638530    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4ba2793-af8d-4cdf-833e-606b02d71d3d" containerName="console"
May 28 07:20:03.682421 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.682390    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:03.682541 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.682534    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.685282 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685254    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 07:20:03.685513 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685500    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 07:20:03.685769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685747    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 07:20:03.685886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685799    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 07:20:03.685886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685812    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g4lvb\""
May 28 07:20:03.685886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685813    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 07:20:03.686078 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.685815    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 07:20:03.686138 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.686122    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 07:20:03.686194 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.686124    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 07:20:03.690789 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.690768    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 07:20:03.849239 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849448 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849247    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849448 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f86c8\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-kube-api-access-f86c8\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849448 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-config-volume\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849448 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-config-out\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849577    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-web-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849722 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849722 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.849722 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.849646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.877907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.877839    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd645ba9-c02e-4f7e-80e5-677556aabe8f" path="/var/lib/kubelet/pods/cd645ba9-c02e-4f7e-80e5-677556aabe8f/volumes"
May 28 07:20:03.950186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950151    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950186 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950193    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950234    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-config-out\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950258    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950280    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-web-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950427    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950499    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950528    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950576    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950610    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950635    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f86c8\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-kube-api-access-f86c8\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950663    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-config-volume\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.950894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.950704    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.951988 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.951493    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.951988 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.951576    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.951988 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.951944    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.953984 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.953955    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.954521 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.954434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c74cd281-64df-4b18-8691-e01566d82c70-config-out\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.954521 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.954486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.954835    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.955059    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955223 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.955141    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-web-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955223 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.955167    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-config-volume\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955875 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.955850    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.955964 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.955858    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c74cd281-64df-4b18-8691-e01566d82c70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.960127 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.960106    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f86c8\" (UniqueName: \"kubernetes.io/projected/c74cd281-64df-4b18-8691-e01566d82c70-kube-api-access-f86c8\") pod \"alertmanager-main-0\" (UID: \"c74cd281-64df-4b18-8691-e01566d82c70\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:03.992510 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:03.992480    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 07:20:04.131593 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:04.131567    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 07:20:04.133785 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:20:04.133755    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74cd281_64df_4b18_8691_e01566d82c70.slice/crio-242596d2ef318f688632e599ffec97de3cb3c2b4f3d3e253bf8143bcc2f3b414 WatchSource:0}: Error finding container 242596d2ef318f688632e599ffec97de3cb3c2b4f3d3e253bf8143bcc2f3b414: Status 404 returned error can't find the container with id 242596d2ef318f688632e599ffec97de3cb3c2b4f3d3e253bf8143bcc2f3b414
May 28 07:20:04.585343 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:04.585302    2570 generic.go:358] "Generic (PLEG): container finished" podID="c74cd281-64df-4b18-8691-e01566d82c70" containerID="4d7fd2a577b1df30516423f35212ec169cd068b43deae6fd06273eff3405b6cb" exitCode=0
May 28 07:20:04.585797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:04.585400    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerDied","Data":"4d7fd2a577b1df30516423f35212ec169cd068b43deae6fd06273eff3405b6cb"}
May 28 07:20:04.585797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:04.585446    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"242596d2ef318f688632e599ffec97de3cb3c2b4f3d3e253bf8143bcc2f3b414"}
May 28 07:20:05.591925 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591886    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"4ea01af2aa68a6177ded6d925e3a596d60c0e47efbb9cd6c67bee61dd1c548c4"}
May 28 07:20:05.591925 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591922    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"d5baa527f4f88c21fe518515b5bc559f083106b655206ccbfc1aa6eda3b440c7"}
May 28 07:20:05.591925 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591931    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"05a527919a1a5e283e7b1a3f0789b8b677ff1cbf586f332cec99f3b2683f9f21"}
May 28 07:20:05.592385 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591940    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"9cee2ac4fc381a55968bfe0cfa2c8e1fc6efe23f8041467317cef91dbe752bc5"}
May 28 07:20:05.592385 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591947    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"82dc98b873bcd59f3b60494a0830e32326165619a8594b7864ede21410251967"}
May 28 07:20:05.592385 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.591956    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c74cd281-64df-4b18-8691-e01566d82c70","Type":"ContainerStarted","Data":"e8f18d50fcafa93dcdbf6b0c7eeac36b48777eb5579eb78cab3f2406b966c1f8"}
May 28 07:20:05.619381 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:05.619184    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.619165668 podStartE2EDuration="2.619165668s" podCreationTimestamp="2026-05-28 07:20:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:20:05.6183932 +0000 UTC m=+194.347299935" watchObservedRunningTime="2026-05-28 07:20:05.619165668 +0000 UTC m=+194.348072406"
May 28 07:20:06.036408 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.036369    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"]
May 28 07:20:06.038882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.038860    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.041424 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.041390    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 07:20:06.041716 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.041433    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 07:20:06.041716 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.041569    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 07:20:06.041900 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.041882    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 07:20:06.041981 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.041957    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 07:20:06.042295 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.042274    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lpf6d\""
May 28 07:20:06.046947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.046925    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 07:20:06.052493 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.052470    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"]
May 28 07:20:06.171010 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.170969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-federate-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-serving-certs-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t85z\" (UniqueName: \"kubernetes.io/projected/8824e993-2cda-42f7-93b5-c33d81fdc6d9-kube-api-access-2t85z\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171362 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171222    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-metrics-client-ca\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.171362 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.171265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.271899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.271859    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.271899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.271901    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t85z\" (UniqueName: \"kubernetes.io/projected/8824e993-2cda-42f7-93b5-c33d81fdc6d9-kube-api-access-2t85z\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272081    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-metrics-client-ca\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272165 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272145    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272221 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272207    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-federate-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272272 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272255    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-serving-certs-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272355 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272308    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272421 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272365    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.272871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272844    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-metrics-client-ca\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.273161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.272905    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-serving-certs-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.273595 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.273567    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.274732 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.274713    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.274840 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.274760    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.275378 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.275357    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-telemeter-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.275467 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.275397    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8824e993-2cda-42f7-93b5-c33d81fdc6d9-federate-client-tls\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.279054 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.279035    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t85z\" (UniqueName: \"kubernetes.io/projected/8824e993-2cda-42f7-93b5-c33d81fdc6d9-kube-api-access-2t85z\") pod \"telemeter-client-66d5bbf55-s2qp8\" (UID: \"8824e993-2cda-42f7-93b5-c33d81fdc6d9\") " pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.349062 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.348995    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"
May 28 07:20:06.493870 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.493842    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66d5bbf55-s2qp8"]
May 28 07:20:06.496635 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:20:06.496605    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8824e993_2cda_42f7_93b5_c33d81fdc6d9.slice/crio-1b6942b6f23d811c2543bace6cd4d64b748149f57770a2f72b187b16dafdf0ee WatchSource:0}: Error finding container 1b6942b6f23d811c2543bace6cd4d64b748149f57770a2f72b187b16dafdf0ee: Status 404 returned error can't find the container with id 1b6942b6f23d811c2543bace6cd4d64b748149f57770a2f72b187b16dafdf0ee
May 28 07:20:06.596781 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:06.596744    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8" event={"ID":"8824e993-2cda-42f7-93b5-c33d81fdc6d9","Type":"ContainerStarted","Data":"1b6942b6f23d811c2543bace6cd4d64b748149f57770a2f72b187b16dafdf0ee"}
May 28 07:20:09.609117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:09.609078    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8" event={"ID":"8824e993-2cda-42f7-93b5-c33d81fdc6d9","Type":"ContainerStarted","Data":"dd6257aa12d11d369bd255757c741fc81de96b15c3da3d93d2812406970fed69"}
May 28 07:20:09.609117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:09.609118    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8" event={"ID":"8824e993-2cda-42f7-93b5-c33d81fdc6d9","Type":"ContainerStarted","Data":"04d882406d310db433cb3a2d78cc05ac11bdcca4f16a96f62b4b7c565086bf29"}
May 28 07:20:09.609581 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:09.609128    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8" event={"ID":"8824e993-2cda-42f7-93b5-c33d81fdc6d9","Type":"ContainerStarted","Data":"be34d4a60c6fa9992d9c04eab838e3de20411cc83b33bd01ec9b8102fa262aa9"}
May 28 07:20:09.631008 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:09.630956    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66d5bbf55-s2qp8" podStartSLOduration=1.39029021 podStartE2EDuration="3.630942616s" podCreationTimestamp="2026-05-28 07:20:06 +0000 UTC" firstStartedPulling="2026-05-28 07:20:06.49852144 +0000 UTC m=+195.227428166" lastFinishedPulling="2026-05-28 07:20:08.739173836 +0000 UTC m=+197.468080572" observedRunningTime="2026-05-28 07:20:09.630017848 +0000 UTC m=+198.358924581" watchObservedRunningTime="2026-05-28 07:20:09.630942616 +0000 UTC m=+198.359849410"
May 28 07:20:10.458762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.458722    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:20:10.460914 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.460897    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.472649 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.472622    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:20:10.618672 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618687    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtcjn\" (UniqueName: \"kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618915    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.619117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.618985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720362 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720253    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720362 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720313    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720565 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720376    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720565 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720399    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720565 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720513    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720814 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720782    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtcjn\" (UniqueName: \"kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.720947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.720925    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.721132 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.721105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.721273 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.721226    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.721273 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.721241    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.721871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.721851    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.723321 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.723293    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.723715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.723694    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.729100 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.729074    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtcjn\" (UniqueName: \"kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn\") pod \"console-589f986765-bc6r7\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") " pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.770815 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.770771    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:10.903572 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:10.903539    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:20:10.906977 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:20:10.906948    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e73697a_4226_4ea9_adcc_628622b13299.slice/crio-e692a180a136af075764044ee1ac2157ef1416d61469f17ae4f00757480a65a3 WatchSource:0}: Error finding container e692a180a136af075764044ee1ac2157ef1416d61469f17ae4f00757480a65a3: Status 404 returned error can't find the container with id e692a180a136af075764044ee1ac2157ef1416d61469f17ae4f00757480a65a3
May 28 07:20:11.618772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:11.618731    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589f986765-bc6r7" event={"ID":"8e73697a-4226-4ea9-adcc-628622b13299","Type":"ContainerStarted","Data":"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"}
May 28 07:20:11.618772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:11.618778    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589f986765-bc6r7" event={"ID":"8e73697a-4226-4ea9-adcc-628622b13299","Type":"ContainerStarted","Data":"e692a180a136af075764044ee1ac2157ef1416d61469f17ae4f00757480a65a3"}
May 28 07:20:11.640107 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:11.640026    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-589f986765-bc6r7" podStartSLOduration=1.640011538 podStartE2EDuration="1.640011538s" podCreationTimestamp="2026-05-28 07:20:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:20:11.639138555 +0000 UTC m=+200.368045289" watchObservedRunningTime="2026-05-28 07:20:11.640011538 +0000 UTC m=+200.368918272"
May 28 07:20:20.771054 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:20.770997    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:20.771054 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:20.771057    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:20.776138 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:20.776110    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:21.654656 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:21.654626    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:20:21.719952 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:21.719919    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:20:46.740552 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:46.740479    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f7df496df-bdk44" podUID="3de14904-366b-4c38-887b-84f9bfd966d9" containerName="console" containerID="cri-o://06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54" gracePeriod=15
May 28 07:20:46.982225 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:46.982196    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f7df496df-bdk44_3de14904-366b-4c38-887b-84f9bfd966d9/console/0.log"
May 28 07:20:46.982414 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:46.982266    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:20:47.132367 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132301    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132567 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132391    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132567 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132484    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132567 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132543    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132567 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132564    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmpn\" (UniqueName: \"kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132603    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132630    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config\") pod \"3de14904-366b-4c38-887b-84f9bfd966d9\" (UID: \"3de14904-366b-4c38-887b-84f9bfd966d9\") "
May 28 07:20:47.132904 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132872    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:47.132904 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132881    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:47.133015 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.132903    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:47.133152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.133120    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config" (OuterVolumeSpecName: "console-config") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:20:47.134945 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.134916    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn" (OuterVolumeSpecName: "kube-api-access-nmmpn") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "kube-api-access-nmmpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:20:47.135029 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.134920    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:47.135029 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.134979    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3de14904-366b-4c38-887b-84f9bfd966d9" (UID: "3de14904-366b-4c38-887b-84f9bfd966d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:20:47.233880 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233832    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-service-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.233880 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233871    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-trusted-ca-bundle\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.233880 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233882    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-oauth-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.233880 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233891    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmpn\" (UniqueName: \"kubernetes.io/projected/3de14904-366b-4c38-887b-84f9bfd966d9-kube-api-access-nmmpn\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.234152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233903    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.234152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233913    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3de14904-366b-4c38-887b-84f9bfd966d9-console-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.234152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.233921    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3de14904-366b-4c38-887b-84f9bfd966d9-console-oauth-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:20:47.738004 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.737974    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f7df496df-bdk44_3de14904-366b-4c38-887b-84f9bfd966d9/console/0.log"
May 28 07:20:47.738180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.738016    2570 generic.go:358] "Generic (PLEG): container finished" podID="3de14904-366b-4c38-887b-84f9bfd966d9" containerID="06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54" exitCode=2
May 28 07:20:47.738180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.738105    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7df496df-bdk44"
May 28 07:20:47.738180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.738126    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7df496df-bdk44" event={"ID":"3de14904-366b-4c38-887b-84f9bfd966d9","Type":"ContainerDied","Data":"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"}
May 28 07:20:47.738180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.738168    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7df496df-bdk44" event={"ID":"3de14904-366b-4c38-887b-84f9bfd966d9","Type":"ContainerDied","Data":"7f68984db17ad6bc8bd25ea0bf37b99ef80f6888743c561ad585a93dd2610cb4"}
May 28 07:20:47.738315 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.738187    2570 scope.go:117] "RemoveContainer" containerID="06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"
May 28 07:20:47.747271 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.747058    2570 scope.go:117] "RemoveContainer" containerID="06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"
May 28 07:20:47.747559 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:20:47.747355    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54\": container with ID starting with 06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54 not found: ID does not exist" containerID="06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"
May 28 07:20:47.747559 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.747380    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54"} err="failed to get container status \"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54\": rpc error: code = NotFound desc = could not find container \"06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54\": container with ID starting with 06e883f79c3ea1fee51a544b823927a57433cd0e5230089e9229a3c2d2bece54 not found: ID does not exist"
May 28 07:20:47.759943 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.759916    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:20:47.766604 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.766581    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7df496df-bdk44"]
May 28 07:20:47.878350 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:20:47.878308    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de14904-366b-4c38-887b-84f9bfd966d9" path="/var/lib/kubelet/pods/3de14904-366b-4c38-887b-84f9bfd966d9/volumes"
May 28 07:21:51.748454 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:51.748423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:21:51.748957 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:51.748430    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:21:51.753524 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:51.753499    2570 kubelet.go:1628] "Image garbage collection succeeded"
May 28 07:21:57.364579 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.364532    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:21:57.366878 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.364862    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de14904-366b-4c38-887b-84f9bfd966d9" containerName="console"
May 28 07:21:57.366878 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.364873    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de14904-366b-4c38-887b-84f9bfd966d9" containerName="console"
May 28 07:21:57.366878 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.364932    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="3de14904-366b-4c38-887b-84f9bfd966d9" containerName="console"
May 28 07:21:57.368013 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.367996    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.377626 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.377601    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:21:57.438677 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438677 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qrf\" (UniqueName: \"kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438896 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438896 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438896 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438896 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.438896 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.438856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540045 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540007    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540060    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540088    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540111    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540145    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540210 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540192    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540215    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qrf\" (UniqueName: \"kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540858    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540955 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540939    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540997 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540960    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.540997 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.540935    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.543301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.543277    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.543410 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.543301    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.551322 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.551298    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qrf\" (UniqueName: \"kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf\") pod \"console-5d787779b7-9q4h7\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") " pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.678607 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.678496    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:21:57.819458 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.819420    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:21:57.823720 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:21:57.823690    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735bd002_de1f_44e5_b438_9caf5527d682.slice/crio-bbc15d9f6ab87c7029fe32e9167b2c663bd17bfed3eec547a45d6b2e1907d94f WatchSource:0}: Error finding container bbc15d9f6ab87c7029fe32e9167b2c663bd17bfed3eec547a45d6b2e1907d94f: Status 404 returned error can't find the container with id bbc15d9f6ab87c7029fe32e9167b2c663bd17bfed3eec547a45d6b2e1907d94f
May 28 07:21:57.825553 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.825538    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:21:57.962390 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.962255    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d787779b7-9q4h7" event={"ID":"735bd002-de1f-44e5-b438-9caf5527d682","Type":"ContainerStarted","Data":"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"}
May 28 07:21:57.962390 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.962313    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d787779b7-9q4h7" event={"ID":"735bd002-de1f-44e5-b438-9caf5527d682","Type":"ContainerStarted","Data":"bbc15d9f6ab87c7029fe32e9167b2c663bd17bfed3eec547a45d6b2e1907d94f"}
May 28 07:21:57.986552 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:21:57.986496    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d787779b7-9q4h7" podStartSLOduration=0.98647953 podStartE2EDuration="986.47953ms" podCreationTimestamp="2026-05-28 07:21:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:21:57.984573731 +0000 UTC m=+306.713480466" watchObservedRunningTime="2026-05-28 07:21:57.98647953 +0000 UTC m=+306.715386263"
May 28 07:22:07.679473 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:07.679438    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:22:07.679473 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:07.679483    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:22:07.684373 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:07.684350    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:22:07.994747 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:07.994662    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:22:08.040942 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:08.040906    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:22:33.062822 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.062756    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-589f986765-bc6r7" podUID="8e73697a-4226-4ea9-adcc-628622b13299" containerName="console" containerID="cri-o://2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2" gracePeriod=15
May 28 07:22:33.313089 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.313029    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-589f986765-bc6r7_8e73697a-4226-4ea9-adcc-628622b13299/console/0.log"
May 28 07:22:33.313202 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.313091    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:22:33.360048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.359986    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360054    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtcjn\" (UniqueName: \"kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360312 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360182    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360312 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360243    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360312 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360278    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360483 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360376    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360483 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360451    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert\") pod \"8e73697a-4226-4ea9-adcc-628622b13299\" (UID: \"8e73697a-4226-4ea9-adcc-628622b13299\") "
May 28 07:22:33.360647 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360603    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:22:33.360647 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360618    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config" (OuterVolumeSpecName: "console-config") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:22:33.360759 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360651    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:22:33.360889 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360757    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-trusted-ca-bundle\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.360955 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360899    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-console-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.360955 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360915    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-service-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.360955 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.360934    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:22:33.362550 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.362514    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:22:33.362715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.362690    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn" (OuterVolumeSpecName: "kube-api-access-dtcjn") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "kube-api-access-dtcjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:22:33.362907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.362875    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e73697a-4226-4ea9-adcc-628622b13299" (UID: "8e73697a-4226-4ea9-adcc-628622b13299"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:22:33.461706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.461664    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.461706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.461695    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e73697a-4226-4ea9-adcc-628622b13299-oauth-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.461706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.461709    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtcjn\" (UniqueName: \"kubernetes.io/projected/8e73697a-4226-4ea9-adcc-628622b13299-kube-api-access-dtcjn\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:33.461942 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:33.461722    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e73697a-4226-4ea9-adcc-628622b13299-console-oauth-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:22:34.071194 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071164    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-589f986765-bc6r7_8e73697a-4226-4ea9-adcc-628622b13299/console/0.log"
May 28 07:22:34.071631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071206    2570 generic.go:358] "Generic (PLEG): container finished" podID="8e73697a-4226-4ea9-adcc-628622b13299" containerID="2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2" exitCode=2
May 28 07:22:34.071631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071298    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-589f986765-bc6r7"
May 28 07:22:34.071631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071299    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589f986765-bc6r7" event={"ID":"8e73697a-4226-4ea9-adcc-628622b13299","Type":"ContainerDied","Data":"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"}
May 28 07:22:34.071631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071361    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-589f986765-bc6r7" event={"ID":"8e73697a-4226-4ea9-adcc-628622b13299","Type":"ContainerDied","Data":"e692a180a136af075764044ee1ac2157ef1416d61469f17ae4f00757480a65a3"}
May 28 07:22:34.071631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.071380    2570 scope.go:117] "RemoveContainer" containerID="2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"
May 28 07:22:34.079816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.079798    2570 scope.go:117] "RemoveContainer" containerID="2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"
May 28 07:22:34.080109 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:22:34.080088    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2\": container with ID starting with 2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2 not found: ID does not exist" containerID="2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"
May 28 07:22:34.080152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.080119    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2"} err="failed to get container status \"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2\": rpc error: code = NotFound desc = could not find container \"2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2\": container with ID starting with 2cf88836252a3cada9a6ed6b27f4b506b59b9448f088aff88e874753fef191a2 not found: ID does not exist"
May 28 07:22:34.089225 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.089202    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:22:34.093706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:34.093683    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-589f986765-bc6r7"]
May 28 07:22:35.878157 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:22:35.878120    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e73697a-4226-4ea9-adcc-628622b13299" path="/var/lib/kubelet/pods/8e73697a-4226-4ea9-adcc-628622b13299/volumes"
May 28 07:23:51.584680 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.584640    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:23:51.585103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.584957    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e73697a-4226-4ea9-adcc-628622b13299" containerName="console"
May 28 07:23:51.585103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.584969    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e73697a-4226-4ea9-adcc-628622b13299" containerName="console"
May 28 07:23:51.585103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.585048    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e73697a-4226-4ea9-adcc-628622b13299" containerName="console"
May 28 07:23:51.588064 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.588046    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:51.590541 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.590516    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-4w8gb\""
May 28 07:23:51.590753 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.590739    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 07:23:51.591600 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.591586    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 07:23:51.597014 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.596985    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:23:51.618315 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.618284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccwb\" (UniqueName: \"kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb\") pod \"feast-operator-controller-manager-75fb7d9844-7x9jt\" (UID: \"b0ecc46e-652e-466d-be7e-305b2b54dd03\") " pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:51.719007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.718961    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jccwb\" (UniqueName: \"kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb\") pod \"feast-operator-controller-manager-75fb7d9844-7x9jt\" (UID: \"b0ecc46e-652e-466d-be7e-305b2b54dd03\") " pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:51.728961 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.728937    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 07:23:51.739747 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.739721    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 07:23:51.750846 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.750817    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccwb\" (UniqueName: \"kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb\") pod \"feast-operator-controller-manager-75fb7d9844-7x9jt\" (UID: \"b0ecc46e-652e-466d-be7e-305b2b54dd03\") " pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:51.901707 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.901621    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-4w8gb\""
May 28 07:23:51.909883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:51.909858    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:52.043975 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:52.043946    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:23:52.046603 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:23:52.046565    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ecc46e_652e_466d_be7e_305b2b54dd03.slice/crio-b1f157591bbddade26cdf07f59ae05a8a0b3e94903d76f3810c91159377748a8 WatchSource:0}: Error finding container b1f157591bbddade26cdf07f59ae05a8a0b3e94903d76f3810c91159377748a8: Status 404 returned error can't find the container with id b1f157591bbddade26cdf07f59ae05a8a0b3e94903d76f3810c91159377748a8
May 28 07:23:52.310877 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:52.310832    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" event={"ID":"b0ecc46e-652e-466d-be7e-305b2b54dd03","Type":"ContainerStarted","Data":"b1f157591bbddade26cdf07f59ae05a8a0b3e94903d76f3810c91159377748a8"}
May 28 07:23:55.322939 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:55.322892    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" event={"ID":"b0ecc46e-652e-466d-be7e-305b2b54dd03","Type":"ContainerStarted","Data":"49dddb824614be640faea69e442e8a23c8659c175ef1a2f9c04a00d82ccef048"}
May 28 07:23:55.323597 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:55.322990    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:23:55.339968 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:23:55.339896    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" podStartSLOduration=1.877275882 podStartE2EDuration="4.339875756s" podCreationTimestamp="2026-05-28 07:23:51 +0000 UTC" firstStartedPulling="2026-05-28 07:23:52.048412217 +0000 UTC m=+420.777318929" lastFinishedPulling="2026-05-28 07:23:54.51101209 +0000 UTC m=+423.239918803" observedRunningTime="2026-05-28 07:23:55.338846227 +0000 UTC m=+424.067752964" watchObservedRunningTime="2026-05-28 07:23:55.339875756 +0000 UTC m=+424.068782491"
May 28 07:24:06.328397 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:06.328304    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:24:35.482732 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.482687    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:24:35.485899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.485869    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.489465 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.489442    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 07:24:35.489697 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.489517    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 07:24:35.489844 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.489581    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 28 07:24:35.489995 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.489752    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 07:24:35.490389 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.490369    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 07:24:35.490524 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.490511    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 07:24:35.490808 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.490788    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 07:24:35.492066 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.490957    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gcv8q\""
May 28 07:24:35.497570 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sdp\" (UniqueName: \"kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.497675 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.497675 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.497779 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.497832 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.497888 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.497837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.509239 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.509211    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:24:35.599248 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599189    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sdp\" (UniqueName: \"kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599248 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599249    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599293    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599393    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599418    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599534 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599450    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.599734 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.599550    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 07:24:35.599734 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.599632    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls podName:2d7701cc-fde7-49e6-baef-0758bd07189a nodeName:}" failed. No retries permitted until 2026-05-28 07:24:36.099608934 +0000 UTC m=+464.828515652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls") pod "feast-simple-feast-setup-bbdf75466-gp8w8" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a") : secret "feast-simple-feast-setup-online-tls" not found
May 28 07:24:35.599734 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.599551    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 07:24:35.599734 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.599709    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls podName:2d7701cc-fde7-49e6-baef-0758bd07189a nodeName:}" failed. No retries permitted until 2026-05-28 07:24:36.099690355 +0000 UTC m=+464.828597075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls") pod "feast-simple-feast-setup-bbdf75466-gp8w8" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 07:24:35.599945 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.599856    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.600096 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.600071    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 28 07:24:35.600240 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:24:35.600134    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls podName:2d7701cc-fde7-49e6-baef-0758bd07189a nodeName:}" failed. No retries permitted until 2026-05-28 07:24:36.10011947 +0000 UTC m=+464.829026198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls") pod "feast-simple-feast-setup-bbdf75466-gp8w8" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a") : secret "feast-simple-feast-setup-registry-tls" not found
May 28 07:24:35.602688 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.602661    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:35.611549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:35.611518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sdp\" (UniqueName: \"kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.104666 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.104624    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.104882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.104675    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.104882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.104709    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.107424 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.107392    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.107556 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.107534    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.107599 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.107533    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-gp8w8\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.110353 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.110302    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:24:36.251911 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.251886    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:24:36.254382 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:24:36.254346    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d7701cc_fde7_49e6_baef_0758bd07189a.slice/crio-2efe252ef9beac0f15da80ab1579bbd5ac45f8bc79296807687a0386cab9f1f0 WatchSource:0}: Error finding container 2efe252ef9beac0f15da80ab1579bbd5ac45f8bc79296807687a0386cab9f1f0: Status 404 returned error can't find the container with id 2efe252ef9beac0f15da80ab1579bbd5ac45f8bc79296807687a0386cab9f1f0
May 28 07:24:36.448744 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:24:36.448651    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"2efe252ef9beac0f15da80ab1579bbd5ac45f8bc79296807687a0386cab9f1f0"}
May 28 07:25:09.559887 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:09.559843    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"}
May 28 07:25:14.576097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:14.576059    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590" exitCode=0
May 28 07:25:14.576524 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:14.576125    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"}
May 28 07:25:15.581501 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:15.581457    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"}
May 28 07:25:20.597723 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:20.597680    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65" exitCode=0
May 28 07:25:20.598208 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:20.597756    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"}
May 28 07:25:20.613684 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:20.613661    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 28 07:25:21.605510 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:21.605465    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"}
May 28 07:25:21.606000 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:21.605522    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"}
May 28 07:25:21.606000 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:21.605538    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"}
May 28 07:25:21.606000 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:21.605552    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerStarted","Data":"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"}
May 28 07:25:21.649299 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:21.649225    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podStartSLOduration=13.857483312 podStartE2EDuration="46.649202709s" podCreationTimestamp="2026-05-28 07:24:35 +0000 UTC" firstStartedPulling="2026-05-28 07:24:36.256654219 +0000 UTC m=+464.985560930" lastFinishedPulling="2026-05-28 07:25:09.048373596 +0000 UTC m=+497.777280327" observedRunningTime="2026-05-28 07:25:21.646793303 +0000 UTC m=+510.375700039" watchObservedRunningTime="2026-05-28 07:25:21.649202709 +0000 UTC m=+510.378109444"
May 28 07:25:23.217375 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.217317    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7df4d694cc-xr52k"]
May 28 07:25:23.220156 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.220129    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.241756 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.241722    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df4d694cc-xr52k"]
May 28 07:25:23.326767 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.326717    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-oauth-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.326976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.326813    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-oauth-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.326976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.326860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-trusted-ca-bundle\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.326976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.326908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6xdg\" (UniqueName: \"kubernetes.io/projected/da915ec4-2005-422b-b6e8-d109fa918131-kube-api-access-z6xdg\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.327141 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.326979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.327141 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.327055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-service-ca\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.327141 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.327082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-console-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428560 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428510    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-service-ca\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428567    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-console-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428605    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-oauth-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428655    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-oauth-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428695    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-trusted-ca-bundle\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.428772 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428730    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6xdg\" (UniqueName: \"kubernetes.io/projected/da915ec4-2005-422b-b6e8-d109fa918131-kube-api-access-z6xdg\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.429048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.428790    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.429369 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.429305    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-service-ca\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.430314 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.430282    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-console-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.430885 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.430852    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-oauth-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.431201 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.431171    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da915ec4-2005-422b-b6e8-d109fa918131-trusted-ca-bundle\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.432230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.432206    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-serving-cert\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.432410 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.432308    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da915ec4-2005-422b-b6e8-d109fa918131-console-oauth-config\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.445665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.445638    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6xdg\" (UniqueName: \"kubernetes.io/projected/da915ec4-2005-422b-b6e8-d109fa918131-kube-api-access-z6xdg\") pod \"console-7df4d694cc-xr52k\" (UID: \"da915ec4-2005-422b-b6e8-d109fa918131\") " pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.534671 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.534626    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:23.733056 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:23.733024    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df4d694cc-xr52k"]
May 28 07:25:23.736424 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:25:23.736373    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda915ec4_2005_422b_b6e8_d109fa918131.slice/crio-d41d487128e35d6f81cc1eeedf848774df3b02d46871661fb258f29b10567e92 WatchSource:0}: Error finding container d41d487128e35d6f81cc1eeedf848774df3b02d46871661fb258f29b10567e92: Status 404 returned error can't find the container with id d41d487128e35d6f81cc1eeedf848774df3b02d46871661fb258f29b10567e92
May 28 07:25:24.110985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.110817    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:24.110985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.110881    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:24.110985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.110895    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:24.112011 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.111983    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:24.113300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.113196    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 28 07:25:24.113300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.113229    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 28 07:25:24.113300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.113252    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
May 28 07:25:24.113300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.113235    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
May 28 07:25:24.619908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.619856    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df4d694cc-xr52k" event={"ID":"da915ec4-2005-422b-b6e8-d109fa918131","Type":"ContainerStarted","Data":"88503a8f3c3d74aae1da8ecdc7ab1c48085df02fcca2d7eec9689228ab629c4a"}
May 28 07:25:24.619908 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.619912    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df4d694cc-xr52k" event={"ID":"da915ec4-2005-422b-b6e8-d109fa918131","Type":"ContainerStarted","Data":"d41d487128e35d6f81cc1eeedf848774df3b02d46871661fb258f29b10567e92"}
May 28 07:25:24.642303 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:24.642236    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7df4d694cc-xr52k" podStartSLOduration=1.6418233880000002 podStartE2EDuration="1.641823388s" podCreationTimestamp="2026-05-28 07:25:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:25:24.639193699 +0000 UTC m=+513.368100434" watchObservedRunningTime="2026-05-28 07:25:24.641823388 +0000 UTC m=+513.370730123"
May 28 07:25:26.111048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:26.111002    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:26.111601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:26.111087    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:26.111601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:26.111125    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:26.111601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:26.111139    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.111639 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.111603    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.112108 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.111822    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.112108 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.112052    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.116197 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.116176    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.630507 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.630472    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.630865 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.630841    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.630953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.630903    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:27.633662 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:27.633637    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:25:33.535290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:33.535245    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:33.535754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:33.535318    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:33.540244 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:33.540222    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:33.653947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:33.653919    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7df4d694cc-xr52k"
May 28 07:25:33.703539 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:33.703503    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:25:58.724808 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:58.724727    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d787779b7-9q4h7" podUID="735bd002-de1f-44e5-b438-9caf5527d682" containerName="console" containerID="cri-o://c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c" gracePeriod=15
May 28 07:25:59.018838 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.018811    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d787779b7-9q4h7_735bd002-de1f-44e5-b438-9caf5527d682/console/0.log"
May 28 07:25:59.018983 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.018887    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:25:59.165639 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165599    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165841 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165654    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165841 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165673    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165958 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165852    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165958 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165900    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165958 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165937    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9qrf\" (UniqueName: \"kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.165958 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.165953    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca\") pod \"735bd002-de1f-44e5-b438-9caf5527d682\" (UID: \"735bd002-de1f-44e5-b438-9caf5527d682\") "
May 28 07:25:59.166214 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.166182    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:25:59.166371 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.166315    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config" (OuterVolumeSpecName: "console-config") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:25:59.166616 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.166397    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca" (OuterVolumeSpecName: "service-ca") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:25:59.166616 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.166432    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:25:59.168113 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.168086    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:25:59.168113 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.168105    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:25:59.168285 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.168108    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf" (OuterVolumeSpecName: "kube-api-access-m9qrf") pod "735bd002-de1f-44e5-b438-9caf5527d682" (UID: "735bd002-de1f-44e5-b438-9caf5527d682"). InnerVolumeSpecName "kube-api-access-m9qrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267073    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9qrf\" (UniqueName: \"kubernetes.io/projected/735bd002-de1f-44e5-b438-9caf5527d682-kube-api-access-m9qrf\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267105    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-service-ca\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267117    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-oauth-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267126    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-serving-cert\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267135    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-trusted-ca-bundle\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267145    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735bd002-de1f-44e5-b438-9caf5527d682-console-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.267169 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.267156    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735bd002-de1f-44e5-b438-9caf5527d682-console-oauth-config\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:25:59.730561 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730530    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d787779b7-9q4h7_735bd002-de1f-44e5-b438-9caf5527d682/console/0.log"
May 28 07:25:59.731009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730573    2570 generic.go:358] "Generic (PLEG): container finished" podID="735bd002-de1f-44e5-b438-9caf5527d682" containerID="c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c" exitCode=2
May 28 07:25:59.731009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730618    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d787779b7-9q4h7" event={"ID":"735bd002-de1f-44e5-b438-9caf5527d682","Type":"ContainerDied","Data":"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"}
May 28 07:25:59.731009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730645    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d787779b7-9q4h7" event={"ID":"735bd002-de1f-44e5-b438-9caf5527d682","Type":"ContainerDied","Data":"bbc15d9f6ab87c7029fe32e9167b2c663bd17bfed3eec547a45d6b2e1907d94f"}
May 28 07:25:59.731009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730646    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d787779b7-9q4h7"
May 28 07:25:59.731009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.730660    2570 scope.go:117] "RemoveContainer" containerID="c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"
May 28 07:25:59.740249 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.740224    2570 scope.go:117] "RemoveContainer" containerID="c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"
May 28 07:25:59.740542 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:25:59.740522    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c\": container with ID starting with c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c not found: ID does not exist" containerID="c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"
May 28 07:25:59.740635 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.740553    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c"} err="failed to get container status \"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c\": rpc error: code = NotFound desc = could not find container \"c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c\": container with ID starting with c74fe5131739e9387b5e14653ccf0a80d13619fdb54d42eb8f26bfd0c4fb044c not found: ID does not exist"
May 28 07:25:59.753411 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.753375    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:25:59.757761 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.757730    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d787779b7-9q4h7"]
May 28 07:25:59.877587 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:25:59.877554    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735bd002-de1f-44e5-b438-9caf5527d682" path="/var/lib/kubelet/pods/735bd002-de1f-44e5-b438-9caf5527d682/volumes"
May 28 07:26:29.047637 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.047602    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:26:29.048032 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.047934    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="registry" containerID="cri-o://50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874" gracePeriod=30
May 28 07:26:29.048032 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.047986    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="offline" containerID="cri-o://261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f" gracePeriod=30
May 28 07:26:29.048032 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.048009    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online" containerID="cri-o://034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3" gracePeriod=30
May 28 07:26:29.048171 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.047991    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui" containerID="cri-o://776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f" gracePeriod=30
May 28 07:26:29.517386 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.517264    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:26:29.517809 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.517785    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735bd002-de1f-44e5-b438-9caf5527d682" containerName="console"
May 28 07:26:29.517864 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.517814    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="735bd002-de1f-44e5-b438-9caf5527d682" containerName="console"
May 28 07:26:29.517911 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.517900    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="735bd002-de1f-44e5-b438-9caf5527d682" containerName="console"
May 28 07:26:29.520968 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.520944    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.527082 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.526696    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ntd2w\""
May 28 07:26:29.555583 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.555547    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:26:29.637462 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.637419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.637818 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.637787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.637933 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.637872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.637990 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.637941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.638042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.637993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.638099 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.638040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbplg\" (UniqueName: \"kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.739612 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739558    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbplg\" (UniqueName: \"kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.739816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739644    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.739816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739694    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.739816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739734    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.739816 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739789    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.740025 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.739827    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.740025 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:29.739829    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 28 07:26:29.740025 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:29.739916    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls podName:01156c76-4ce5-46cf-8319-b8d943161b65 nodeName:}" failed. No retries permitted until 2026-05-28 07:26:30.23989363 +0000 UTC m=+578.968800364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls") pod "feast-simple-feast-setup-bbdf75466-m5ddb" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65") : secret "feast-simple-feast-setup-registry-tls" not found
May 28 07:26:29.740025 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:29.739921    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 07:26:29.740025 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:29.739969    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls podName:01156c76-4ce5-46cf-8319-b8d943161b65 nodeName:}" failed. No retries permitted until 2026-05-28 07:26:30.239952261 +0000 UTC m=+578.968858979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls") pod "feast-simple-feast-setup-bbdf75466-m5ddb" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65") : secret "feast-simple-feast-setup-online-tls" not found
May 28 07:26:29.740367 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.740317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.742981 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.742956    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.743097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.743002    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.754781 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.754754    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbplg\" (UniqueName: \"kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:29.825934 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.825900    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f" exitCode=0
May 28 07:26:29.826079 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:29.825971    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"}
May 28 07:26:30.245545 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.245502    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:30.246026 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.245572    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:30.248132 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.248104    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:30.248221 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.248113    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") pod \"feast-simple-feast-setup-bbdf75466-m5ddb\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") " pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:30.432869 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.432766    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:30.596205 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.596155    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:26:30.598445 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:26:30.598416    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01156c76_4ce5_46cf_8319_b8d943161b65.slice/crio-4ac222e6be037ea0e2b6eaeeea58a0715988f385951a6c5ee7b7f5e54f8b0d40 WatchSource:0}: Error finding container 4ac222e6be037ea0e2b6eaeeea58a0715988f385951a6c5ee7b7f5e54f8b0d40: Status 404 returned error can't find the container with id 4ac222e6be037ea0e2b6eaeeea58a0715988f385951a6c5ee7b7f5e54f8b0d40
May 28 07:26:30.831552 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.831508    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"}
May 28 07:26:30.831552 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.831558    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"4ac222e6be037ea0e2b6eaeeea58a0715988f385951a6c5ee7b7f5e54f8b0d40"}
May 28 07:26:30.835891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.835851    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3" exitCode=0
May 28 07:26:30.836061 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:30.835951    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"}
May 28 07:26:35.853325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:35.853287    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377" exitCode=0
May 28 07:26:35.853831 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:35.853367    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"}
May 28 07:26:36.857703 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:36.857665    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"}
May 28 07:26:37.630899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:37.630820    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 28 07:26:37.631248 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:37.630820    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 28 07:26:41.875101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:41.874996    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d" exitCode=0
May 28 07:26:41.877511 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:41.877478    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"}
May 28 07:26:42.883233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:42.883187    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"}
May 28 07:26:42.883233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:42.883247    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"}
May 28 07:26:42.883837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:42.883266    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"}
May 28 07:26:42.883837 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:42.883280    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerStarted","Data":"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"}
May 28 07:26:42.931185 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:42.928947    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podStartSLOduration=13.928924729 podStartE2EDuration="13.928924729s" podCreationTimestamp="2026-05-28 07:26:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:26:42.928205221 +0000 UTC m=+591.657111957" watchObservedRunningTime="2026-05-28 07:26:42.928924729 +0000 UTC m=+591.657831463"
May 28 07:26:45.433668 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.433627    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:45.434228 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.434210    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:45.434350 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.434319    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:45.434448 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.434438    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:45.436005 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.435958    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 28 07:26:45.436161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.436028    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 28 07:26:45.436161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.436044    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
May 28 07:26:45.436161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:45.435967    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
May 28 07:26:47.631468 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:47.631420    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 28 07:26:47.632071 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:47.631569    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 28 07:26:48.433781 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.433741    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434070 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434036    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434539 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434514    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434678 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434546    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434678 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434556    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434678 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434596    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.434678 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.434625    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.438627 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.438603    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.904578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.904543    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.904578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.904586    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.905161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.905142    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:48.907450 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:48.907424    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:26:51.773973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:51.773933    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:26:51.775275 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:51.775247    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:26:57.631289 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:57.631242    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 28 07:26:57.632649 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:57.631237    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
May 28 07:26:57.632649 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:57.631421    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:26:57.632649 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:57.631515    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:26:59.698829 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.698804    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:26:59.837797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837705    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8sdp\" (UniqueName: \"kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.837797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837741    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.837797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837778    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.837797 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837801    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.838128 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837836    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.838128 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.837870    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") pod \"2d7701cc-fde7-49e6-baef-0758bd07189a\" (UID: \"2d7701cc-fde7-49e6-baef-0758bd07189a\") "
May 28 07:26:59.838702 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.838419    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data" (OuterVolumeSpecName: "feast-data") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:26:59.840271 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.840241    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:26:59.840377 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.840268    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp" (OuterVolumeSpecName: "kube-api-access-b8sdp") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "kube-api-access-b8sdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:26:59.840425 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.840371    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:26:59.840544 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.840522    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls" (OuterVolumeSpecName: "online-tls") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:26:59.840601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.840576    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2d7701cc-fde7-49e6-baef-0758bd07189a" (UID: "2d7701cc-fde7-49e6-baef-0758bd07189a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:26:59.938581 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938536    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8sdp\" (UniqueName: \"kubernetes.io/projected/2d7701cc-fde7-49e6-baef-0758bd07189a-kube-api-access-b8sdp\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.938581 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938580    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.938818 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938595    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-offline-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.938818 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938608    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.938818 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938621    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7701cc-fde7-49e6-baef-0758bd07189a-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.938818 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.938631    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2d7701cc-fde7-49e6-baef-0758bd07189a-ui-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:26:59.940857 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940826    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f" exitCode=137
May 28 07:26:59.940857 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940852    2570 generic.go:358] "Generic (PLEG): container finished" podID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerID="50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874" exitCode=137
May 28 07:26:59.941031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940897    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"}
May 28 07:26:59.941031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940925    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"}
May 28 07:26:59.941031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940936    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8" event={"ID":"2d7701cc-fde7-49e6-baef-0758bd07189a","Type":"ContainerDied","Data":"2efe252ef9beac0f15da80ab1579bbd5ac45f8bc79296807687a0386cab9f1f0"}
May 28 07:26:59.941031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940953    2570 scope.go:117] "RemoveContainer" containerID="776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"
May 28 07:26:59.941031 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.940966    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"
May 28 07:26:59.950244 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.950222    2570 scope.go:117] "RemoveContainer" containerID="261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"
May 28 07:26:59.958372 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.958342    2570 scope.go:117] "RemoveContainer" containerID="034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"
May 28 07:26:59.966278 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.966238    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:26:59.966586 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.966571    2570 scope.go:117] "RemoveContainer" containerID="50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"
May 28 07:26:59.972723 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.972696    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-gp8w8"]
May 28 07:26:59.975209 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.975188    2570 scope.go:117] "RemoveContainer" containerID="48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"
May 28 07:26:59.983073 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.983056    2570 scope.go:117] "RemoveContainer" containerID="5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"
May 28 07:26:59.990197 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990175    2570 scope.go:117] "RemoveContainer" containerID="776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"
May 28 07:26:59.990467 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.990444    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f\": container with ID starting with 776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f not found: ID does not exist" containerID="776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"
May 28 07:26:59.990527 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990483    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"} err="failed to get container status \"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f\": rpc error: code = NotFound desc = could not find container \"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f\": container with ID starting with 776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f not found: ID does not exist"
May 28 07:26:59.990527 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990505    2570 scope.go:117] "RemoveContainer" containerID="261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"
May 28 07:26:59.990754 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.990740    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f\": container with ID starting with 261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f not found: ID does not exist" containerID="261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"
May 28 07:26:59.990798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990757    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"} err="failed to get container status \"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f\": rpc error: code = NotFound desc = could not find container \"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f\": container with ID starting with 261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f not found: ID does not exist"
May 28 07:26:59.990798 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990788    2570 scope.go:117] "RemoveContainer" containerID="034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"
May 28 07:26:59.990962 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.990948    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3\": container with ID starting with 034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3 not found: ID does not exist" containerID="034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"
May 28 07:26:59.991004 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990967    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"} err="failed to get container status \"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3\": rpc error: code = NotFound desc = could not find container \"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3\": container with ID starting with 034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3 not found: ID does not exist"
May 28 07:26:59.991004 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.990985    2570 scope.go:117] "RemoveContainer" containerID="50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"
May 28 07:26:59.991190 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.991176    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874\": container with ID starting with 50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874 not found: ID does not exist" containerID="50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"
May 28 07:26:59.991234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991192    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"} err="failed to get container status \"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874\": rpc error: code = NotFound desc = could not find container \"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874\": container with ID starting with 50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874 not found: ID does not exist"
May 28 07:26:59.991234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991204    2570 scope.go:117] "RemoveContainer" containerID="48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"
May 28 07:26:59.991419 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.991400    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65\": container with ID starting with 48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65 not found: ID does not exist" containerID="48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"
May 28 07:26:59.991469 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991426    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"} err="failed to get container status \"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65\": rpc error: code = NotFound desc = could not find container \"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65\": container with ID starting with 48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65 not found: ID does not exist"
May 28 07:26:59.991469 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991444    2570 scope.go:117] "RemoveContainer" containerID="5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"
May 28 07:26:59.991670 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:26:59.991653    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590\": container with ID starting with 5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590 not found: ID does not exist" containerID="5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"
May 28 07:26:59.991715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991672    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"} err="failed to get container status \"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590\": rpc error: code = NotFound desc = could not find container \"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590\": container with ID starting with 5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590 not found: ID does not exist"
May 28 07:26:59.991715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991683    2570 scope.go:117] "RemoveContainer" containerID="776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"
May 28 07:26:59.991855 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991840    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f"} err="failed to get container status \"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f\": rpc error: code = NotFound desc = could not find container \"776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f\": container with ID starting with 776e2cbf6cd08f2c5b74a72d6c40076b17012bedb6a2e793966e6d9ced845b2f not found: ID does not exist"
May 28 07:26:59.991893 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.991855    2570 scope.go:117] "RemoveContainer" containerID="261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"
May 28 07:26:59.992079 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992055    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f"} err="failed to get container status \"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f\": rpc error: code = NotFound desc = could not find container \"261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f\": container with ID starting with 261850a58ce8ee35027fda0224262a4f63fa9d74d0c55a455781050b5c2e472f not found: ID does not exist"
May 28 07:26:59.992131 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992080    2570 scope.go:117] "RemoveContainer" containerID="034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"
May 28 07:26:59.992275 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992258    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3"} err="failed to get container status \"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3\": rpc error: code = NotFound desc = could not find container \"034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3\": container with ID starting with 034300e2b42d9c70167be9d10c5cd9130a47bf297538df06f9f9820bed0e04b3 not found: ID does not exist"
May 28 07:26:59.992316 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992276    2570 scope.go:117] "RemoveContainer" containerID="50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"
May 28 07:26:59.992521 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992503    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874"} err="failed to get container status \"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874\": rpc error: code = NotFound desc = could not find container \"50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874\": container with ID starting with 50010edc5c5b40ceb57083e42ad510cd2625e9599606e7fe222f64e9c1cde874 not found: ID does not exist"
May 28 07:26:59.992566 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992523    2570 scope.go:117] "RemoveContainer" containerID="48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"
May 28 07:26:59.992748 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992728    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65"} err="failed to get container status \"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65\": rpc error: code = NotFound desc = could not find container \"48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65\": container with ID starting with 48a1d00185cf3db11ff49ef831e14eecf9959faa90cc13f71213dd0cf1001d65 not found: ID does not exist"
May 28 07:26:59.992791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992749    2570 scope.go:117] "RemoveContainer" containerID="5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"
May 28 07:26:59.992956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:26:59.992941    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590"} err="failed to get container status \"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590\": rpc error: code = NotFound desc = could not find container \"5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590\": container with ID starting with 5819386b63f8b10f409a63e3f81c9f376c939a5582a15aff59660896bf797590 not found: ID does not exist"
May 28 07:27:01.877664 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:01.877625    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" path="/var/lib/kubelet/pods/2d7701cc-fde7-49e6-baef-0758bd07189a/volumes"
May 28 07:27:51.003178 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003132    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003615    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="registry"
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003630    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="registry"
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003646    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="feast-apply"
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003655    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="feast-apply"
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003666    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online"
May 28 07:27:51.003693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003675    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003702    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="feast-init"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003710    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="feast-init"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003727    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003735    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003748    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="offline"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003756    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="offline"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003822    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="offline"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003838    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="online"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003848    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="ui"
May 28 07:27:51.003879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.003859    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d7701cc-fde7-49e6-baef-0758bd07189a" containerName="registry"
May 28 07:27:51.007763 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.007738    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.010603 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010419    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 07:27:51.010603 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010432    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 28 07:27:51.010603 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010463    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-m6sf2\""
May 28 07:27:51.010603 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010555    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 07:27:51.010847 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010641    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 07:27:51.010959 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010943    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 07:27:51.011028 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.010972    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 07:27:51.011140 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.011030    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 07:27:51.019092 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.019047    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:27:51.068846 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.068807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.068999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.068881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.068999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.068933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.068999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.068961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.068999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.068989    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.069161 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.069032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqk5c\" (UniqueName: \"kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170008 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.169965    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqk5c\" (UniqueName: \"kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170036    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170107    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170147    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170171    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170199    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170537 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:27:51.170294    2570 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 07:27:51.170537 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:27:51.170342    2570 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 07:27:51.170537 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:27:51.170370    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls podName:a49be13a-47e2-4318-a764-c90c768da60e nodeName:}" failed. No retries permitted until 2026-05-28 07:27:51.670349657 +0000 UTC m=+660.399256383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls") pod "feast-simple-feast-remote-setup-5c4898849c-7c7rm" (UID: "a49be13a-47e2-4318-a764-c90c768da60e") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 07:27:51.170537 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:27:51.170439    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls podName:a49be13a-47e2-4318-a764-c90c768da60e nodeName:}" failed. No retries permitted until 2026-05-28 07:27:51.670411843 +0000 UTC m=+660.399318562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls") pod "feast-simple-feast-remote-setup-5c4898849c-7c7rm" (UID: "a49be13a-47e2-4318-a764-c90c768da60e") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 07:27:51.170753 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170553    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.170849 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.170824    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.173152 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.173118    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.180379 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.180351    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqk5c\" (UniqueName: \"kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.675980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.675940    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.675980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.675982    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.678625 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.678593    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.678752 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.678672    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") pod \"feast-simple-feast-remote-setup-5c4898849c-7c7rm\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:51.923770 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.923738    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-m6sf2\""
May 28 07:27:51.931148 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:51.931064    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:27:52.073654 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:52.073612    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:27:52.077410 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:27:52.077378    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49be13a_47e2_4318_a764_c90c768da60e.slice/crio-4b23e7dbaa778823379f718f09600c78543ca71e3ce0f3be8258debf455b2de9 WatchSource:0}: Error finding container 4b23e7dbaa778823379f718f09600c78543ca71e3ce0f3be8258debf455b2de9: Status 404 returned error can't find the container with id 4b23e7dbaa778823379f718f09600c78543ca71e3ce0f3be8258debf455b2de9
May 28 07:27:52.079202 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:52.079183    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:27:52.102291 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:52.102260    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"4b23e7dbaa778823379f718f09600c78543ca71e3ce0f3be8258debf455b2de9"}
May 28 07:27:53.106762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:53.106725    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"03bd60959292d88d09bdeaf8a0b759cd39b64243b608e0e69ca9fe1f9b566e1a"}
May 28 07:27:57.119824 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:57.119788    2570 generic.go:358] "Generic (PLEG): container finished" podID="a49be13a-47e2-4318-a764-c90c768da60e" containerID="03bd60959292d88d09bdeaf8a0b759cd39b64243b608e0e69ca9fe1f9b566e1a" exitCode=0
May 28 07:27:57.120234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:57.119870    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"03bd60959292d88d09bdeaf8a0b759cd39b64243b608e0e69ca9fe1f9b566e1a"}
May 28 07:27:58.125839 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:27:58.125799    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"38a8c83d9860def570dc1fd28c84d407a2ded9457375c0fb4ead0b9262ed1275"}
May 28 07:28:03.145817 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:03.145783    2570 generic.go:358] "Generic (PLEG): container finished" podID="a49be13a-47e2-4318-a764-c90c768da60e" containerID="38a8c83d9860def570dc1fd28c84d407a2ded9457375c0fb4ead0b9262ed1275" exitCode=0
May 28 07:28:03.146215 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:03.145857    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"38a8c83d9860def570dc1fd28c84d407a2ded9457375c0fb4ead0b9262ed1275"}
May 28 07:28:03.150951 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:03.150932    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 28 07:28:04.156882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:04.156838    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"d37a4b2fbbe68239f4ab78da0ed8b2de8898ba56380fda4bbfc70262bd927070"}
May 28 07:28:04.156882 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:04.156889    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"28ef1a5cd4d331b61361ac6e7fdf767e8cbe8f0e0fc0e1f58fd184f896044cad"}
May 28 07:28:04.157536 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:04.156900    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerStarted","Data":"b5eeb16e984b038a401cd67593e608f63b3ae6f915f4928051911c2fc5eec132"}
May 28 07:28:04.187100 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:04.187026    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podStartSLOduration=14.187005277 podStartE2EDuration="14.187005277s" podCreationTimestamp="2026-05-28 07:27:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:28:04.18388581 +0000 UTC m=+672.912792568" watchObservedRunningTime="2026-05-28 07:28:04.187005277 +0000 UTC m=+672.915912012"
May 28 07:28:06.931950 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.931911    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:06.932562 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.932534    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:06.932562 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.932561    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:06.933903 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.933871    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
May 28 07:28:06.934027 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.933929    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 28 07:28:06.934027 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:06.933881    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 28 07:28:09.932112 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932067    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.932618 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932449    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.932618 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932549    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.932618 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932593    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.932973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932955    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.933038 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.932998    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:09.936706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:09.936689    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:10.179162 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:10.179128    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:28:10.182375 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:28:10.182289    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:29:12.374541 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.374500    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:29:12.375105 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.374929    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online" containerID="cri-o://b5eeb16e984b038a401cd67593e608f63b3ae6f915f4928051911c2fc5eec132" gracePeriod=30
May 28 07:29:12.375105 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.374982    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui" containerID="cri-o://d37a4b2fbbe68239f4ab78da0ed8b2de8898ba56380fda4bbfc70262bd927070" gracePeriod=30
May 28 07:29:12.375105 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.374999    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="offline" containerID="cri-o://28ef1a5cd4d331b61361ac6e7fdf767e8cbe8f0e0fc0e1f58fd184f896044cad" gracePeriod=30
May 28 07:29:12.570752 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.570714    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:29:12.571101 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.571072    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="registry" containerID="cri-o://a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91" gracePeriod=30
May 28 07:29:12.571180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.571136    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online" containerID="cri-o://8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05" gracePeriod=30
May 28 07:29:12.571180 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.571136    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui" containerID="cri-o://f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820" gracePeriod=30
May 28 07:29:12.571287 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:12.571167    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="offline" containerID="cri-o://1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453" gracePeriod=30
May 28 07:29:13.381119 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.381082    2570 generic.go:358] "Generic (PLEG): container finished" podID="a49be13a-47e2-4318-a764-c90c768da60e" containerID="d37a4b2fbbe68239f4ab78da0ed8b2de8898ba56380fda4bbfc70262bd927070" exitCode=0
May 28 07:29:13.381119 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.381110    2570 generic.go:358] "Generic (PLEG): container finished" podID="a49be13a-47e2-4318-a764-c90c768da60e" containerID="b5eeb16e984b038a401cd67593e608f63b3ae6f915f4928051911c2fc5eec132" exitCode=0
May 28 07:29:13.381667 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.381159    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"d37a4b2fbbe68239f4ab78da0ed8b2de8898ba56380fda4bbfc70262bd927070"}
May 28 07:29:13.381667 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.381199    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"b5eeb16e984b038a401cd67593e608f63b3ae6f915f4928051911c2fc5eec132"}
May 28 07:29:13.383857 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.383828    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820" exitCode=0
May 28 07:29:13.383988 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:13.383886    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"}
May 28 07:29:14.390191 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:14.390155    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05" exitCode=0
May 28 07:29:14.390614 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:14.390222    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"}
May 28 07:29:18.905398 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:18.905319    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 28 07:29:18.905398 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:18.905378    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 28 07:29:19.933512 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:19.933467    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 28 07:29:20.179754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:20.179701    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 28 07:29:28.904838 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:28.904789    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 28 07:29:28.905368 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:28.904801    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 28 07:29:29.932894 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:29.932843    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 28 07:29:30.179587 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:30.179547    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 28 07:29:38.904986 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:38.904938    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 28 07:29:38.905518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:38.904950    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 28 07:29:38.905518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:38.905061    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:29:38.905518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:38.905245    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:29:39.933476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:39.933425    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 28 07:29:39.933919 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:39.933585    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:29:40.179829 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:40.179784    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 28 07:29:40.180006 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:40.179912    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:29:42.483482 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:42.483441    2570 generic.go:358] "Generic (PLEG): container finished" podID="a49be13a-47e2-4318-a764-c90c768da60e" containerID="28ef1a5cd4d331b61361ac6e7fdf767e8cbe8f0e0fc0e1f58fd184f896044cad" exitCode=137
May 28 07:29:42.483836 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:42.483513    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"28ef1a5cd4d331b61361ac6e7fdf767e8cbe8f0e0fc0e1f58fd184f896044cad"}
May 28 07:29:43.026490 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.026463    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:29:43.076711 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.076670    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.076972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.076748    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqk5c\" (UniqueName: \"kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.076972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.076830    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.076972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.076878    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.076972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.076904    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.077176 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.077043    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data\") pod \"a49be13a-47e2-4318-a764-c90c768da60e\" (UID: \"a49be13a-47e2-4318-a764-c90c768da60e\") "
May 28 07:29:43.077389 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.077359    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 07:29:43.077617 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.077589    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data" (OuterVolumeSpecName: "feast-data") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:29:43.079263 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.079239    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls" (OuterVolumeSpecName: "online-tls") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.079370 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.079260    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c" (OuterVolumeSpecName: "kube-api-access-gqk5c") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "kube-api-access-gqk5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:29:43.079518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.079497    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.079578 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.079530    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a49be13a-47e2-4318-a764-c90c768da60e" (UID: "a49be13a-47e2-4318-a764-c90c768da60e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.177754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177723    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-offline-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.177754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177751    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a49be13a-47e2-4318-a764-c90c768da60e-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.177754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177760    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a49be13a-47e2-4318-a764-c90c768da60e-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.177973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177769    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-ui-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.177973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177779    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqk5c\" (UniqueName: \"kubernetes.io/projected/a49be13a-47e2-4318-a764-c90c768da60e-kube-api-access-gqk5c\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.177973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.177787    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a49be13a-47e2-4318-a764-c90c768da60e-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.214056 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.214029    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:29:43.278549 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278513    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.278740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278561    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.278740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278605    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.278740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278629    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbplg\" (UniqueName: \"kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.278740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278650    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.278740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.278680    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls\") pod \"01156c76-4ce5-46cf-8319-b8d943161b65\" (UID: \"01156c76-4ce5-46cf-8319-b8d943161b65\") "
May 28 07:29:43.279493 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.279226    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data" (OuterVolumeSpecName: "feast-data") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:29:43.281050 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.281018    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.281050 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.281022    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg" (OuterVolumeSpecName: "kube-api-access-qbplg") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "kube-api-access-qbplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:29:43.281205 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.281052    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.281205 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.281183    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls" (OuterVolumeSpecName: "online-tls") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.281276 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.281213    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "01156c76-4ce5-46cf-8319-b8d943161b65" (UID: "01156c76-4ce5-46cf-8319-b8d943161b65"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:29:43.379433 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379393    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-ui-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.379433 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379426    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbplg\" (UniqueName: \"kubernetes.io/projected/01156c76-4ce5-46cf-8319-b8d943161b65-kube-api-access-qbplg\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.379433 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379440    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01156c76-4ce5-46cf-8319-b8d943161b65-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.379663 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379450    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-offline-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.379663 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379460    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.379663 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.379468    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01156c76-4ce5-46cf-8319-b8d943161b65-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:29:43.495048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.494940    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm" event={"ID":"a49be13a-47e2-4318-a764-c90c768da60e","Type":"ContainerDied","Data":"4b23e7dbaa778823379f718f09600c78543ca71e3ce0f3be8258debf455b2de9"}
May 28 07:29:43.495048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.494994    2570 scope.go:117] "RemoveContainer" containerID="d37a4b2fbbe68239f4ab78da0ed8b2de8898ba56380fda4bbfc70262bd927070"
May 28 07:29:43.495048 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.494950    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"
May 28 07:29:43.497825 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497789    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453" exitCode=137
May 28 07:29:43.497825 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497821    2570 generic.go:358] "Generic (PLEG): container finished" podID="01156c76-4ce5-46cf-8319-b8d943161b65" containerID="a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91" exitCode=137
May 28 07:29:43.498018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497857    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"}
May 28 07:29:43.498018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497893    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"
May 28 07:29:43.498018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497911    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"}
May 28 07:29:43.498018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.497927    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb" event={"ID":"01156c76-4ce5-46cf-8319-b8d943161b65","Type":"ContainerDied","Data":"4ac222e6be037ea0e2b6eaeeea58a0715988f385951a6c5ee7b7f5e54f8b0d40"}
May 28 07:29:43.506183 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.506159    2570 scope.go:117] "RemoveContainer" containerID="28ef1a5cd4d331b61361ac6e7fdf767e8cbe8f0e0fc0e1f58fd184f896044cad"
May 28 07:29:43.514075 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.514052    2570 scope.go:117] "RemoveContainer" containerID="b5eeb16e984b038a401cd67593e608f63b3ae6f915f4928051911c2fc5eec132"
May 28 07:29:43.518322 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.518296    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:29:43.521462 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.521437    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5c4898849c-7c7rm"]
May 28 07:29:43.524119 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.524101    2570 scope.go:117] "RemoveContainer" containerID="38a8c83d9860def570dc1fd28c84d407a2ded9457375c0fb4ead0b9262ed1275"
May 28 07:29:43.531724 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.531651    2570 scope.go:117] "RemoveContainer" containerID="03bd60959292d88d09bdeaf8a0b759cd39b64243b608e0e69ca9fe1f9b566e1a"
May 28 07:29:43.533859 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.533831    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:29:43.538224 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.538199    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-bbdf75466-m5ddb"]
May 28 07:29:43.540999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.540983    2570 scope.go:117] "RemoveContainer" containerID="f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"
May 28 07:29:43.548559 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.548541    2570 scope.go:117] "RemoveContainer" containerID="1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"
May 28 07:29:43.555503 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.555486    2570 scope.go:117] "RemoveContainer" containerID="8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"
May 28 07:29:43.562512 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.562495    2570 scope.go:117] "RemoveContainer" containerID="a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"
May 28 07:29:43.569347 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.569299    2570 scope.go:117] "RemoveContainer" containerID="3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"
May 28 07:29:43.576319 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.576303    2570 scope.go:117] "RemoveContainer" containerID="71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"
May 28 07:29:43.583542 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.583523    2570 scope.go:117] "RemoveContainer" containerID="f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"
May 28 07:29:43.583801 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.583774    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820\": container with ID starting with f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820 not found: ID does not exist" containerID="f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"
May 28 07:29:43.583862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.583808    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"} err="failed to get container status \"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820\": rpc error: code = NotFound desc = could not find container \"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820\": container with ID starting with f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820 not found: ID does not exist"
May 28 07:29:43.583862 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.583826    2570 scope.go:117] "RemoveContainer" containerID="1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"
May 28 07:29:43.584060 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.584042    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453\": container with ID starting with 1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453 not found: ID does not exist" containerID="1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"
May 28 07:29:43.584110 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584064    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"} err="failed to get container status \"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453\": rpc error: code = NotFound desc = could not find container \"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453\": container with ID starting with 1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453 not found: ID does not exist"
May 28 07:29:43.584110 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584079    2570 scope.go:117] "RemoveContainer" containerID="8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"
May 28 07:29:43.584281 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.584265    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05\": container with ID starting with 8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05 not found: ID does not exist" containerID="8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"
May 28 07:29:43.584320 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584286    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"} err="failed to get container status \"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05\": rpc error: code = NotFound desc = could not find container \"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05\": container with ID starting with 8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05 not found: ID does not exist"
May 28 07:29:43.584320 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584299    2570 scope.go:117] "RemoveContainer" containerID="a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"
May 28 07:29:43.584527 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.584511    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91\": container with ID starting with a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91 not found: ID does not exist" containerID="a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"
May 28 07:29:43.584570 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584530    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"} err="failed to get container status \"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91\": rpc error: code = NotFound desc = could not find container \"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91\": container with ID starting with a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91 not found: ID does not exist"
May 28 07:29:43.584570 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584543    2570 scope.go:117] "RemoveContainer" containerID="3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"
May 28 07:29:43.584753 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.584738    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d\": container with ID starting with 3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d not found: ID does not exist" containerID="3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"
May 28 07:29:43.584796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584753    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"} err="failed to get container status \"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d\": rpc error: code = NotFound desc = could not find container \"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d\": container with ID starting with 3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d not found: ID does not exist"
May 28 07:29:43.584796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584764    2570 scope.go:117] "RemoveContainer" containerID="71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"
May 28 07:29:43.584944 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:29:43.584926    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377\": container with ID starting with 71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377 not found: ID does not exist" containerID="71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"
May 28 07:29:43.585036 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584946    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"} err="failed to get container status \"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377\": rpc error: code = NotFound desc = could not find container \"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377\": container with ID starting with 71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377 not found: ID does not exist"
May 28 07:29:43.585036 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.584962    2570 scope.go:117] "RemoveContainer" containerID="f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"
May 28 07:29:43.585178 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585154    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820"} err="failed to get container status \"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820\": rpc error: code = NotFound desc = could not find container \"f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820\": container with ID starting with f79b8f35f40fdda5632e3ad9c8d8515a0d11c37deddf7f85d986aafc684f8820 not found: ID does not exist"
May 28 07:29:43.585231 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585181    2570 scope.go:117] "RemoveContainer" containerID="1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"
May 28 07:29:43.585439 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585418    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453"} err="failed to get container status \"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453\": rpc error: code = NotFound desc = could not find container \"1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453\": container with ID starting with 1575a8243f421f14dca54a46efe431484ee5bc5cfb13187352a2e1f4fdc26453 not found: ID does not exist"
May 28 07:29:43.585502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585439    2570 scope.go:117] "RemoveContainer" containerID="8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"
May 28 07:29:43.585706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585686    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05"} err="failed to get container status \"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05\": rpc error: code = NotFound desc = could not find container \"8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05\": container with ID starting with 8bbf2152f7bfc8abe39b7a9516c1a1a813dfa4fb7d3f16b15a4a9c27f6292c05 not found: ID does not exist"
May 28 07:29:43.585746 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585707    2570 scope.go:117] "RemoveContainer" containerID="a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"
May 28 07:29:43.585899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585882    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91"} err="failed to get container status \"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91\": rpc error: code = NotFound desc = could not find container \"a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91\": container with ID starting with a72c12e1eddcead2985b1637fcda506a387e7a3595a1d38a02fcbbb05cb7da91 not found: ID does not exist"
May 28 07:29:43.585944 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.585900    2570 scope.go:117] "RemoveContainer" containerID="3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"
May 28 07:29:43.586072 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.586056    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d"} err="failed to get container status \"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d\": rpc error: code = NotFound desc = could not find container \"3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d\": container with ID starting with 3d64aeabce63df0bcaf9d7bf143c06e92074b9763f969a17ac8895058a997d6d not found: ID does not exist"
May 28 07:29:43.586118 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.586072    2570 scope.go:117] "RemoveContainer" containerID="71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"
May 28 07:29:43.586265 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.586250    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377"} err="failed to get container status \"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377\": rpc error: code = NotFound desc = could not find container \"71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377\": container with ID starting with 71eca58f2cb9049e598e104512a3c79f6130ca41ade64330a4d650cbb5f0c377 not found: ID does not exist"
May 28 07:29:43.878259 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.878219    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" path="/var/lib/kubelet/pods/01156c76-4ce5-46cf-8319-b8d943161b65/volumes"
May 28 07:29:43.878886 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:43.878869    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49be13a-47e2-4318-a764-c90c768da60e" path="/var/lib/kubelet/pods/a49be13a-47e2-4318-a764-c90c768da60e/volumes"
May 28 07:29:55.377217 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377175    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377577    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377592    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377603    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="feast-init"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377609    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="feast-init"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377617    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377625    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377634    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="feast-init"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377639    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="feast-init"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377646    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="feast-apply"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377652    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="feast-apply"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377658    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="feast-apply"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377678    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="feast-apply"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377684    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="offline"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377689    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="offline"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377701    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377708    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377716    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="registry"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377721    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="registry"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377732    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="offline"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377736    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="offline"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377746    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377752    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377810    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="offline"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377818    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="online"
May 28 07:29:55.377807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377825    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="ui"
May 28 07:29:55.378757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377832    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="offline"
May 28 07:29:55.378757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377839    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="01156c76-4ce5-46cf-8319-b8d943161b65" containerName="registry"
May 28 07:29:55.378757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377846    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="ui"
May 28 07:29:55.378757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.377854    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="a49be13a-47e2-4318-a764-c90c768da60e" containerName="online"
May 28 07:29:55.383164 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.383139    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.386876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.385969    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 07:29:55.387371 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.387325    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-8vls4\""
May 28 07:29:55.387689 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.387365    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 28 07:29:55.388185 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.387435    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 07:29:55.388575 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.388557    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:29:55.415691 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.415663    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:29:55.418980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.418964    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:29:55.425410 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.425383    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:29:55.480103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.480062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.480103 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.480108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qj2z\" (UniqueName: \"kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z\") pod \"redis-854544c579-j25hg\" (UID: \"3b15f391-6e97-4a7a-91e7-473e47f87e47\") " pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:29:55.480369 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.480229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9s86\" (UniqueName: \"kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.581393 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.581305    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.581393 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.581388    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qj2z\" (UniqueName: \"kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z\") pod \"redis-854544c579-j25hg\" (UID: \"3b15f391-6e97-4a7a-91e7-473e47f87e47\") " pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:29:55.581661 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.581451    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9s86\" (UniqueName: \"kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.581715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.581682    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.590252 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.590218    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9s86\" (UniqueName: \"kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86\") pod \"postgres-7c7656cc6d-ldgg9\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") " pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.590405 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.590291    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qj2z\" (UniqueName: \"kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z\") pod \"redis-854544c579-j25hg\" (UID: \"3b15f391-6e97-4a7a-91e7-473e47f87e47\") " pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:29:55.703518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.703439    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:29:55.730105 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.730074    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:29:55.849164 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.849123    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:29:55.853084 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:29:55.853053    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc58e24c9_5151_456a_8d8e_7e0dba5cb926.slice/crio-7ffc599d47174ec8a4a14faa1ec2da5441310fbcd3dd40c4562e914878cc35cb WatchSource:0}: Error finding container 7ffc599d47174ec8a4a14faa1ec2da5441310fbcd3dd40c4562e914878cc35cb: Status 404 returned error can't find the container with id 7ffc599d47174ec8a4a14faa1ec2da5441310fbcd3dd40c4562e914878cc35cb
May 28 07:29:55.871810 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:55.871784    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:29:55.874132 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:29:55.874104    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b15f391_6e97_4a7a_91e7_473e47f87e47.slice/crio-dba908c0a48cb70c36c0b48ef2d2096f6f9488f45934ed2f63bdbe266c0abecc WatchSource:0}: Error finding container dba908c0a48cb70c36c0b48ef2d2096f6f9488f45934ed2f63bdbe266c0abecc: Status 404 returned error can't find the container with id dba908c0a48cb70c36c0b48ef2d2096f6f9488f45934ed2f63bdbe266c0abecc
May 28 07:29:56.540780 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:56.540734    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" event={"ID":"c58e24c9-5151-456a-8d8e-7e0dba5cb926","Type":"ContainerStarted","Data":"7ffc599d47174ec8a4a14faa1ec2da5441310fbcd3dd40c4562e914878cc35cb"}
May 28 07:29:56.541968 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:56.541919    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-j25hg" event={"ID":"3b15f391-6e97-4a7a-91e7-473e47f87e47","Type":"ContainerStarted","Data":"dba908c0a48cb70c36c0b48ef2d2096f6f9488f45934ed2f63bdbe266c0abecc"}
May 28 07:29:58.551820 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:58.551780    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-j25hg" event={"ID":"3b15f391-6e97-4a7a-91e7-473e47f87e47","Type":"ContainerStarted","Data":"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"}
May 28 07:29:58.568944 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:29:58.568885    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-j25hg" podStartSLOduration=1.828385089 podStartE2EDuration="3.568868715s" podCreationTimestamp="2026-05-28 07:29:55 +0000 UTC" firstStartedPulling="2026-05-28 07:29:55.875783898 +0000 UTC m=+784.604690614" lastFinishedPulling="2026-05-28 07:29:57.616267528 +0000 UTC m=+786.345174240" observedRunningTime="2026-05-28 07:29:58.566498637 +0000 UTC m=+787.295405373" watchObservedRunningTime="2026-05-28 07:29:58.568868715 +0000 UTC m=+787.297775449"
May 28 07:30:02.565099 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:02.565054    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" event={"ID":"c58e24c9-5151-456a-8d8e-7e0dba5cb926","Type":"ContainerStarted","Data":"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"}
May 28 07:30:02.580932 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:02.580869    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" podStartSLOduration=1.6131054740000002 podStartE2EDuration="7.58084919s" podCreationTimestamp="2026-05-28 07:29:55 +0000 UTC" firstStartedPulling="2026-05-28 07:29:55.854964096 +0000 UTC m=+784.583870817" lastFinishedPulling="2026-05-28 07:30:01.822707805 +0000 UTC m=+790.551614533" observedRunningTime="2026-05-28 07:30:02.579594428 +0000 UTC m=+791.308501163" watchObservedRunningTime="2026-05-28 07:30:02.58084919 +0000 UTC m=+791.309755928"
May 28 07:30:06.123233 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.123143    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:30:06.129915 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.129892    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.132680 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.132650    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 28 07:30:06.133033 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.133007    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 28 07:30:06.133033 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.133018    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-2r7bt\""
May 28 07:30:06.133268 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.133117    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 28 07:30:06.133443 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.133426    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 07:30:06.149950 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.149895    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:30:06.183692 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.183648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.183907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.183756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.183907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.183796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.183907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.183821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddw2k\" (UniqueName: \"kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.184075 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.183963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.284985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.284942    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285162 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.285015    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285162 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.285065    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285162 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.285098    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285162 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.285127    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddw2k\" (UniqueName: \"kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285357 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:30:06.285293    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 28 07:30:06.285416 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.285396    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.285461 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:30:06.285409    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls podName:e5ef2e43-1c07-4404-b3d2-53999ecffbb0 nodeName:}" failed. No retries permitted until 2026-05-28 07:30:06.785383912 +0000 UTC m=+795.514290624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls") pod "feast-credit-scoring-689bd6b87d-kzpks" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0") : secret "feast-credit-scoring-online-tls" not found
May 28 07:30:06.287778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.287748    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.287778 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.287773    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.294843 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.294821    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddw2k\" (UniqueName: \"kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.790222 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.790175    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:06.792868 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:06.792829    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") pod \"feast-credit-scoring-689bd6b87d-kzpks\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") " pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:07.046985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:07.046873    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:07.191234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:07.191205    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:30:07.193237 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:30:07.193195    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ef2e43_1c07_4404_b3d2_53999ecffbb0.slice/crio-a25db6ff90775f8e0a60ba07d3ec219c993985d923a23ba80a47a59142f44030 WatchSource:0}: Error finding container a25db6ff90775f8e0a60ba07d3ec219c993985d923a23ba80a47a59142f44030: Status 404 returned error can't find the container with id a25db6ff90775f8e0a60ba07d3ec219c993985d923a23ba80a47a59142f44030
May 28 07:30:07.585602 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:07.585566    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"}
May 28 07:30:07.585602 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:07.585606    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"a25db6ff90775f8e0a60ba07d3ec219c993985d923a23ba80a47a59142f44030"}
May 28 07:30:08.590087 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:08.590047    2570 generic.go:358] "Generic (PLEG): container finished" podID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerID="39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e" exitCode=0
May 28 07:30:08.590589 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:08.590098    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"}
May 28 07:30:09.595055 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:09.595012    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"}
May 28 07:30:15.614924 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:15.614887    2570 generic.go:358] "Generic (PLEG): container finished" podID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerID="50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01" exitCode=0
May 28 07:30:15.615376 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:15.614962    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"}
May 28 07:30:16.622735 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:16.622690    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"}
May 28 07:30:16.623239 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:16.622742    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"}
May 28 07:30:16.623239 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:16.622757    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerStarted","Data":"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"}
May 28 07:30:16.648451 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:16.648387    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podStartSLOduration=10.648365411 podStartE2EDuration="10.648365411s" podCreationTimestamp="2026-05-28 07:30:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:30:16.647402694 +0000 UTC m=+805.376309452" watchObservedRunningTime="2026-05-28 07:30:16.648365411 +0000 UTC m=+805.377272143"
May 28 07:30:17.047147 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:17.047097    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:17.047386 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:17.047162    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:17.047386 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:17.047181    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:19.047791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.047744    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:19.047791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.047788    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:19.047791 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.047800    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:19.049924 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.049886    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
May 28 07:30:19.050037 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.049951    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 28 07:30:19.050037 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:19.049886    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
May 28 07:30:22.047240 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:22.047188    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
May 28 07:30:22.048290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:22.048267    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:22.049284 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:22.049261    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:22.053090 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:22.053060    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:22.648600 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:22.648561    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:25.047732 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:25.047671    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
May 28 07:30:28.047952 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:28.047908    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:30:28.048662 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:30:28.048637    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:31:33.268871 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.268834    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:31:33.269408 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.269163    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry" containerID="cri-o://61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6" gracePeriod=30
May 28 07:31:33.269408 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.269259    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online" containerID="cri-o://6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b" gracePeriod=30
May 28 07:31:33.269408 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.269277    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="offline" containerID="cri-o://bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e" gracePeriod=30
May 28 07:31:33.289536 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.289504    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:31:33.289758 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.289717    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" podUID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" containerName="postgres" containerID="cri-o://47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622" gracePeriod=30
May 28 07:31:33.297453 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.297423    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:31:33.297680 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.297656    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-j25hg" podUID="3b15f391-6e97-4a7a-91e7-473e47f87e47" containerName="redis" containerID="cri-o://45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d" gracePeriod=30
May 28 07:31:33.563373 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.563324    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:31:33.566755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.566731    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:31:33.678646 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.678611    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9s86\" (UniqueName: \"kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86\") pod \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") "
May 28 07:31:33.678833 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.678672    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qj2z\" (UniqueName: \"kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z\") pod \"3b15f391-6e97-4a7a-91e7-473e47f87e47\" (UID: \"3b15f391-6e97-4a7a-91e7-473e47f87e47\") "
May 28 07:31:33.678833 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.678719    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata\") pod \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\" (UID: \"c58e24c9-5151-456a-8d8e-7e0dba5cb926\") "
May 28 07:31:33.680876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.680848    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86" (OuterVolumeSpecName: "kube-api-access-m9s86") pod "c58e24c9-5151-456a-8d8e-7e0dba5cb926" (UID: "c58e24c9-5151-456a-8d8e-7e0dba5cb926"). InnerVolumeSpecName "kube-api-access-m9s86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:31:33.681009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.680881    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z" (OuterVolumeSpecName: "kube-api-access-5qj2z") pod "3b15f391-6e97-4a7a-91e7-473e47f87e47" (UID: "3b15f391-6e97-4a7a-91e7-473e47f87e47"). InnerVolumeSpecName "kube-api-access-5qj2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:31:33.708911 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.708870    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "c58e24c9-5151-456a-8d8e-7e0dba5cb926" (UID: "c58e24c9-5151-456a-8d8e-7e0dba5cb926"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:31:33.780228 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.780181    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9s86\" (UniqueName: \"kubernetes.io/projected/c58e24c9-5151-456a-8d8e-7e0dba5cb926-kube-api-access-m9s86\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:31:33.780228 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.780223    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qj2z\" (UniqueName: \"kubernetes.io/projected/3b15f391-6e97-4a7a-91e7-473e47f87e47-kube-api-access-5qj2z\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:31:33.780228 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.780233    2570 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c58e24c9-5151-456a-8d8e-7e0dba5cb926-postgresdata\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:31:33.881795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.881662    2570 generic.go:358] "Generic (PLEG): container finished" podID="3b15f391-6e97-4a7a-91e7-473e47f87e47" containerID="45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d" exitCode=0
May 28 07:31:33.881795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.881719    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-j25hg"
May 28 07:31:33.881795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.881739    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-j25hg" event={"ID":"3b15f391-6e97-4a7a-91e7-473e47f87e47","Type":"ContainerDied","Data":"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"}
May 28 07:31:33.882078 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.881896    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-j25hg" event={"ID":"3b15f391-6e97-4a7a-91e7-473e47f87e47","Type":"ContainerDied","Data":"dba908c0a48cb70c36c0b48ef2d2096f6f9488f45934ed2f63bdbe266c0abecc"}
May 28 07:31:33.882078 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.881927    2570 scope.go:117] "RemoveContainer" containerID="45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"
May 28 07:31:33.883607 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.883542    2570 generic.go:358] "Generic (PLEG): container finished" podID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" containerID="47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622" exitCode=0
May 28 07:31:33.883607 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.883613    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" event={"ID":"c58e24c9-5151-456a-8d8e-7e0dba5cb926","Type":"ContainerDied","Data":"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"}
May 28 07:31:33.883607 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.883636    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9" event={"ID":"c58e24c9-5151-456a-8d8e-7e0dba5cb926","Type":"ContainerDied","Data":"7ffc599d47174ec8a4a14faa1ec2da5441310fbcd3dd40c4562e914878cc35cb"}
May 28 07:31:33.883856 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.883612    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ldgg9"
May 28 07:31:33.891972 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.891948    2570 scope.go:117] "RemoveContainer" containerID="45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"
May 28 07:31:33.892273 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:31:33.892248    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d\": container with ID starting with 45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d not found: ID does not exist" containerID="45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"
May 28 07:31:33.892397 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.892286    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d"} err="failed to get container status \"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d\": rpc error: code = NotFound desc = could not find container \"45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d\": container with ID starting with 45ee476ee3cb4003950e65d59ef384d71aa81cac393d3784a909353d0c79a34d not found: ID does not exist"
May 28 07:31:33.892397 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.892311    2570 scope.go:117] "RemoveContainer" containerID="47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"
May 28 07:31:33.902032 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.902008    2570 scope.go:117] "RemoveContainer" containerID="47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"
May 28 07:31:33.902368 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:31:33.902347    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622\": container with ID starting with 47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622 not found: ID does not exist" containerID="47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"
May 28 07:31:33.902434 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.902376    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622"} err="failed to get container status \"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622\": rpc error: code = NotFound desc = could not find container \"47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622\": container with ID starting with 47429e0ad908aeeb02a51892a4d952991821812615e90f5263f0f1a7c9f20622 not found: ID does not exist"
May 28 07:31:33.908823 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.908796    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:31:33.913389 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.913358    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ldgg9"]
May 28 07:31:33.922624 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.922599    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:31:33.925716 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:33.925691    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-j25hg"]
May 28 07:31:34.890254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:34.890210    2570 generic.go:358] "Generic (PLEG): container finished" podID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerID="6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b" exitCode=0
May 28 07:31:34.890666 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:34.890272    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"}
May 28 07:31:35.877726 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:35.877697    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b15f391-6e97-4a7a-91e7-473e47f87e47" path="/var/lib/kubelet/pods/3b15f391-6e97-4a7a-91e7-473e47f87e47/volumes"
May 28 07:31:35.878025 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:35.878013    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" path="/var/lib/kubelet/pods/c58e24c9-5151-456a-8d8e-7e0dba5cb926/volumes"
May 28 07:31:42.646396 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:42.646320    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 28 07:31:51.796355 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:51.796301    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:31:51.798042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:51.798016    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:31:52.646234 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:31:52.646188    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 28 07:32:02.645848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:02.645796    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 28 07:32:02.647418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:02.645942    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:32:03.924098 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.924070    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:32:03.989765 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989730    2570 generic.go:358] "Generic (PLEG): container finished" podID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerID="bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e" exitCode=137
May 28 07:32:03.989765 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989758    2570 generic.go:358] "Generic (PLEG): container finished" podID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerID="61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6" exitCode=137
May 28 07:32:03.989982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989810    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"}
May 28 07:32:03.989982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989847    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"}
May 28 07:32:03.989982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989858    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks" event={"ID":"e5ef2e43-1c07-4404-b3d2-53999ecffbb0","Type":"ContainerDied","Data":"a25db6ff90775f8e0a60ba07d3ec219c993985d923a23ba80a47a59142f44030"}
May 28 07:32:03.989982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989873    2570 scope.go:117] "RemoveContainer" containerID="bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"
May 28 07:32:03.989982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.989823    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"
May 28 07:32:03.998038 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:03.998013    2570 scope.go:117] "RemoveContainer" containerID="6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"
May 28 07:32:04.005461 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.005445    2570 scope.go:117] "RemoveContainer" containerID="61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"
May 28 07:32:04.013159 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.013141    2570 scope.go:117] "RemoveContainer" containerID="50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"
May 28 07:32:04.020208 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.020191    2570 scope.go:117] "RemoveContainer" containerID="39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"
May 28 07:32:04.029218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.029198    2570 scope.go:117] "RemoveContainer" containerID="bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"
May 28 07:32:04.029517 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:32:04.029497    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e\": container with ID starting with bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e not found: ID does not exist" containerID="bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"
May 28 07:32:04.029587 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.029527    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"} err="failed to get container status \"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e\": rpc error: code = NotFound desc = could not find container \"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e\": container with ID starting with bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e not found: ID does not exist"
May 28 07:32:04.029587 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.029548    2570 scope.go:117] "RemoveContainer" containerID="6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"
May 28 07:32:04.029802 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:32:04.029782    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b\": container with ID starting with 6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b not found: ID does not exist" containerID="6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"
May 28 07:32:04.029848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.029808    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"} err="failed to get container status \"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b\": rpc error: code = NotFound desc = could not find container \"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b\": container with ID starting with 6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b not found: ID does not exist"
May 28 07:32:04.029848 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.029826    2570 scope.go:117] "RemoveContainer" containerID="61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"
May 28 07:32:04.030045 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:32:04.030027    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6\": container with ID starting with 61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6 not found: ID does not exist" containerID="61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"
May 28 07:32:04.030097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030052    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"} err="failed to get container status \"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6\": rpc error: code = NotFound desc = could not find container \"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6\": container with ID starting with 61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6 not found: ID does not exist"
May 28 07:32:04.030097 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030069    2570 scope.go:117] "RemoveContainer" containerID="50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"
May 28 07:32:04.030281 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:32:04.030262    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01\": container with ID starting with 50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01 not found: ID does not exist" containerID="50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"
May 28 07:32:04.030325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030285    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"} err="failed to get container status \"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01\": rpc error: code = NotFound desc = could not find container \"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01\": container with ID starting with 50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01 not found: ID does not exist"
May 28 07:32:04.030325 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030300    2570 scope.go:117] "RemoveContainer" containerID="39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"
May 28 07:32:04.030605 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:32:04.030540    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e\": container with ID starting with 39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e not found: ID does not exist" containerID="39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"
May 28 07:32:04.030605 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030559    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"} err="failed to get container status \"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e\": rpc error: code = NotFound desc = could not find container \"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e\": container with ID starting with 39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e not found: ID does not exist"
May 28 07:32:04.030605 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030573    2570 scope.go:117] "RemoveContainer" containerID="bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"
May 28 07:32:04.030783 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030766    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e"} err="failed to get container status \"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e\": rpc error: code = NotFound desc = could not find container \"bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e\": container with ID starting with bf4ed3eb2d339475eec796ad10add0abbae94215cc4b7ae55c50f772c85a291e not found: ID does not exist"
May 28 07:32:04.030831 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030784    2570 scope.go:117] "RemoveContainer" containerID="6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"
May 28 07:32:04.030993 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030977    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b"} err="failed to get container status \"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b\": rpc error: code = NotFound desc = could not find container \"6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b\": container with ID starting with 6e779ee91c1d48bc92910a26c30761439c86b8e981342ee6262cd7bbfceedf5b not found: ID does not exist"
May 28 07:32:04.031043 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.030993    2570 scope.go:117] "RemoveContainer" containerID="61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"
May 28 07:32:04.031211 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.031191    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6"} err="failed to get container status \"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6\": rpc error: code = NotFound desc = could not find container \"61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6\": container with ID starting with 61338a50d0d2b1aac833964e078ec2569121dd95d72d326543ea53c3f205a6a6 not found: ID does not exist"
May 28 07:32:04.031283 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.031213    2570 scope.go:117] "RemoveContainer" containerID="50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"
May 28 07:32:04.031447 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.031430    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01"} err="failed to get container status \"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01\": rpc error: code = NotFound desc = could not find container \"50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01\": container with ID starting with 50ff1230d0bdff50a802bb0af88221467bd2b06639220fb6646091498459aa01 not found: ID does not exist"
May 28 07:32:04.031502 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.031447    2570 scope.go:117] "RemoveContainer" containerID="39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"
May 28 07:32:04.031628 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.031607    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e"} err="failed to get container status \"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e\": rpc error: code = NotFound desc = could not find container \"39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e\": container with ID starting with 39f67d3808220ee72b90bfd4c7cae1760d986851f703ddff41330aa730c0576e not found: ID does not exist"
May 28 07:32:04.046970 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.046918    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls\") pod \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") "
May 28 07:32:04.046970 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.046960    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data\") pod \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") "
May 28 07:32:04.047090 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.047015    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") pod \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") "
May 28 07:32:04.047090 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.047033    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddw2k\" (UniqueName: \"kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k\") pod \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") "
May 28 07:32:04.047090 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.047068    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls\") pod \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\" (UID: \"e5ef2e43-1c07-4404-b3d2-53999ecffbb0\") "
May 28 07:32:04.049220 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.049192    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e5ef2e43-1c07-4404-b3d2-53999ecffbb0" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:32:04.049401 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.049372    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k" (OuterVolumeSpecName: "kube-api-access-ddw2k") pod "e5ef2e43-1c07-4404-b3d2-53999ecffbb0" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0"). InnerVolumeSpecName "kube-api-access-ddw2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:32:04.049519 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.049407    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e5ef2e43-1c07-4404-b3d2-53999ecffbb0" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:32:04.049519 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.049468    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls" (OuterVolumeSpecName: "online-tls") pod "e5ef2e43-1c07-4404-b3d2-53999ecffbb0" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:32:04.055787 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.055764    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data" (OuterVolumeSpecName: "feast-data") pod "e5ef2e43-1c07-4404-b3d2-53999ecffbb0" (UID: "e5ef2e43-1c07-4404-b3d2-53999ecffbb0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:32:04.148676 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.148640    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:32:04.148676 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.148669    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddw2k\" (UniqueName: \"kubernetes.io/projected/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-kube-api-access-ddw2k\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:32:04.148676 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.148682    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:32:04.148902 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.148690    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-offline-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:32:04.148902 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.148698    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e5ef2e43-1c07-4404-b3d2-53999ecffbb0-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:32:04.312652 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.312613    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:32:04.317036 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:04.316999    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-689bd6b87d-kzpks"]
May 28 07:32:05.882973 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:32:05.882917    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" path="/var/lib/kubelet/pods/e5ef2e43-1c07-4404-b3d2-53999ecffbb0/volumes"
May 28 07:33:37.895702 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.895607    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.895967    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="offline"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.895982    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="offline"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896010    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" containerName="postgres"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896016    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" containerName="postgres"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896026    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b15f391-6e97-4a7a-91e7-473e47f87e47" containerName="redis"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896037    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b15f391-6e97-4a7a-91e7-473e47f87e47" containerName="redis"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896044    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="feast-apply"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896049    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="feast-apply"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896056    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896061    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896067    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896072    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896087    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="feast-init"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896091    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="feast-init"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896187    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="registry"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896200    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b15f391-6e97-4a7a-91e7-473e47f87e47" containerName="redis"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896213    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="offline"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896226    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="c58e24c9-5151-456a-8d8e-7e0dba5cb926" containerName="postgres"
May 28 07:33:37.896243 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.896238    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5ef2e43-1c07-4404-b3d2-53999ecffbb0" containerName="online"
May 28 07:33:37.899379 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.899354    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:33:37.902444 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.902413    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 28 07:33:37.902575 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.902487    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 28 07:33:37.903431 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.903412    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-jxd2m\""
May 28 07:33:37.918827 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:37.918794    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:33:38.060675 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.060616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtxjs\" (UniqueName: \"kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs\") pod \"redis-854544c579-cl5cv\" (UID: \"c04601cb-cdbc-48a3-a8f9-00003c6603e2\") " pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:33:38.161525 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.161405    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtxjs\" (UniqueName: \"kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs\") pod \"redis-854544c579-cl5cv\" (UID: \"c04601cb-cdbc-48a3-a8f9-00003c6603e2\") " pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:33:38.170469 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.170437    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtxjs\" (UniqueName: \"kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs\") pod \"redis-854544c579-cl5cv\" (UID: \"c04601cb-cdbc-48a3-a8f9-00003c6603e2\") " pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:33:38.221154 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.221102    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:33:38.354320 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.354294    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:33:38.357222 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:33:38.357194    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc04601cb_cdbc_48a3_a8f9_00003c6603e2.slice/crio-4b9f6e55302e5f8e77683ea1cffcee2bf9274dfcd57c94a90f1fa65131ec6f93 WatchSource:0}: Error finding container 4b9f6e55302e5f8e77683ea1cffcee2bf9274dfcd57c94a90f1fa65131ec6f93: Status 404 returned error can't find the container with id 4b9f6e55302e5f8e77683ea1cffcee2bf9274dfcd57c94a90f1fa65131ec6f93
May 28 07:33:38.358953 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:38.358936    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:33:39.279574 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:39.279533    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-cl5cv" event={"ID":"c04601cb-cdbc-48a3-a8f9-00003c6603e2","Type":"ContainerStarted","Data":"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"}
May 28 07:33:39.279574 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:39.279578    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-cl5cv" event={"ID":"c04601cb-cdbc-48a3-a8f9-00003c6603e2","Type":"ContainerStarted","Data":"4b9f6e55302e5f8e77683ea1cffcee2bf9274dfcd57c94a90f1fa65131ec6f93"}
May 28 07:33:39.298194 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:39.298147    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-cl5cv" podStartSLOduration=2.298132574 podStartE2EDuration="2.298132574s" podCreationTimestamp="2026-05-28 07:33:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:33:39.296568853 +0000 UTC m=+1008.025475588" watchObservedRunningTime="2026-05-28 07:33:39.298132574 +0000 UTC m=+1008.027039308"
May 28 07:33:43.360607 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.360567    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:33:43.363832 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.363808    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.366179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.366156    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 28 07:33:43.371800 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.371768    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:33:43.509010 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.508975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.509172 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.509055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcc5\" (UniqueName: \"kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.610462 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.610420    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcc5\" (UniqueName: \"kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.610698 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.610496    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.610841 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.610823    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.619947 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.619918    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcc5\" (UniqueName: \"kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5\") pod \"postgres-7c7656cc6d-rhvgq\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.676889 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.676854    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:33:43.808404 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:43.808366    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:33:43.811514 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:33:43.811482    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85fdb9d5_2f8c_439b_a5dd_79f89101efe6.slice/crio-45828f465888fa1b8b45fafd89b5d5d56684aecb2986c4c8665eda0058eb5b09 WatchSource:0}: Error finding container 45828f465888fa1b8b45fafd89b5d5d56684aecb2986c4c8665eda0058eb5b09: Status 404 returned error can't find the container with id 45828f465888fa1b8b45fafd89b5d5d56684aecb2986c4c8665eda0058eb5b09
May 28 07:33:44.295754 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:44.295710    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" event={"ID":"85fdb9d5-2f8c-439b-a5dd-79f89101efe6","Type":"ContainerStarted","Data":"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"}
May 28 07:33:44.295941 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:44.295767    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" event={"ID":"85fdb9d5-2f8c-439b-a5dd-79f89101efe6","Type":"ContainerStarted","Data":"45828f465888fa1b8b45fafd89b5d5d56684aecb2986c4c8665eda0058eb5b09"}
May 28 07:33:44.313991 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:44.313940    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" podStartSLOduration=1.313920185 podStartE2EDuration="1.313920185s" podCreationTimestamp="2026-05-28 07:33:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:33:44.313431262 +0000 UTC m=+1013.042337999" watchObservedRunningTime="2026-05-28 07:33:44.313920185 +0000 UTC m=+1013.042826920"
May 28 07:33:49.053503 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.053464    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:33:49.057929 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.057904    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.058700 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.058662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.058864 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.058714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.058864 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.058741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.058864 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.058769    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lhc\" (UniqueName: \"kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.060583 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.060560    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 28 07:33:49.060663 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.060597    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-rsmvk\""
May 28 07:33:49.060762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.060691    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 28 07:33:49.060762 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.060693    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 28 07:33:49.066976 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.066772    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:33:49.159859 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.159821    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.159859 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.159874    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.160157 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.159902    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.160157 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.159927    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lhc\" (UniqueName: \"kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.160157 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:33:49.160056    2570 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
May 28 07:33:49.160157 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:33:49.160145    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls podName:023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2 nodeName:}" failed. No retries permitted until 2026-05-28 07:33:49.660120352 +0000 UTC m=+1018.389027080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls") pod "feast-credit-scoring-7d75b57b87-xwnj2" (UID: "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2") : secret "feast-credit-scoring-registry-tls" not found
May 28 07:33:49.160373 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.160259    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.162636 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.162612    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.169484 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.169462    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lhc\" (UniqueName: \"kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.663742 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.663684    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.666312 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.666285    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") pod \"feast-credit-scoring-7d75b57b87-xwnj2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") " pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.670175 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.670146    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:33:49.806907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:49.806868    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:33:49.809922 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:33:49.809891    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023bd2d8_e1e9_43ba_aad2_eafb7e0c36c2.slice/crio-8dc7d060497df9c29f8e59d7cce562b83f5d1af8242e9eccf1f2b1468307cf93 WatchSource:0}: Error finding container 8dc7d060497df9c29f8e59d7cce562b83f5d1af8242e9eccf1f2b1468307cf93: Status 404 returned error can't find the container with id 8dc7d060497df9c29f8e59d7cce562b83f5d1af8242e9eccf1f2b1468307cf93
May 28 07:33:50.318827 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:50.318787    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerStarted","Data":"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"}
May 28 07:33:50.318827 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:50.318829    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerStarted","Data":"8dc7d060497df9c29f8e59d7cce562b83f5d1af8242e9eccf1f2b1468307cf93"}
May 28 07:33:51.322899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:51.322863    2570 generic.go:358] "Generic (PLEG): container finished" podID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerID="b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4" exitCode=0
May 28 07:33:51.323390 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:51.322929    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerDied","Data":"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"}
May 28 07:33:52.327934 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:52.327893    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerStarted","Data":"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"}
May 28 07:33:59.351147 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:59.351108    2570 generic.go:358] "Generic (PLEG): container finished" podID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerID="b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1" exitCode=0
May 28 07:33:59.351586 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:59.351190    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerDied","Data":"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"}
May 28 07:33:59.356056 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:33:59.356036    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 28 07:34:00.357747 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:00.357696    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerStarted","Data":"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"}
May 28 07:34:00.358126 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:00.357762    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerStarted","Data":"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"}
May 28 07:34:00.380446 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:00.380379    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podStartSLOduration=11.380365644 podStartE2EDuration="11.380365644s" podCreationTimestamp="2026-05-28 07:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:34:00.378939045 +0000 UTC m=+1029.107845779" watchObservedRunningTime="2026-05-28 07:34:00.380365644 +0000 UTC m=+1029.109272377"
May 28 07:34:01.671050 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:01.670993    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:01.671050 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:01.671062    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:01.672674 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:01.672628    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
May 28 07:34:01.672807 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:01.672678    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
May 28 07:34:04.670646 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:04.670608    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
May 28 07:34:04.671194 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:04.670595    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
May 28 07:34:07.671230 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:07.671181    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
May 28 07:34:07.676733 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:07.676701    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:07.677237 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:07.677206    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:07.680046 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:07.680022    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:09.671294 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:09.671248    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:10.670719 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:10.670673    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
May 28 07:34:13.671706 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:13.671668    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:13.672470 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:13.672451    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:34:15.013934 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.013889    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:34:15.019907 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.019886    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.023185 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.023144    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 28 07:34:15.023360 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.023199    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 28 07:34:15.023360 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.023207    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-9hm2h\""
May 28 07:34:15.023597 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.023581    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 28 07:34:15.029179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.028766    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:34:15.096250 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.096194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.096507 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.096259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwl4f\" (UniqueName: \"kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.096507 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.096384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.096635 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.096564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.197589 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.197540    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.197589 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.197588    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.197883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.197610    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwl4f\" (UniqueName: \"kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.197883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.197630    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.197883 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:34:15.197729    2570 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
May 28 07:34:15.197883 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:34:15.197813    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls podName:edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0 nodeName:}" failed. No retries permitted until 2026-05-28 07:34:15.697789973 +0000 UTC m=+1044.426696692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls") pod "feast-driver-ranking-b577fffb-55rdq" (UID: "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0") : secret "feast-driver-ranking-registry-tls" not found
May 28 07:34:15.198059 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.198036    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.200216 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.200196    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.207018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.206989    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwl4f\" (UniqueName: \"kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.702657 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.702599    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.705195 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.705161    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") pod \"feast-driver-ranking-b577fffb-55rdq\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") " pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:15.931109 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:15.931061    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:16.072869 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:16.072841    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:34:16.075616 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:34:16.075583    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd2cdf1_bbc5_4acf_bbd7_c2eb33be99a0.slice/crio-a21e493127093fd081e7b6b96320342c7e1b2921c863e962ea78548cf5991957 WatchSource:0}: Error finding container a21e493127093fd081e7b6b96320342c7e1b2921c863e962ea78548cf5991957: Status 404 returned error can't find the container with id a21e493127093fd081e7b6b96320342c7e1b2921c863e962ea78548cf5991957
May 28 07:34:16.412425 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:16.412386    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerStarted","Data":"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"}
May 28 07:34:16.412425 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:16.412430    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerStarted","Data":"a21e493127093fd081e7b6b96320342c7e1b2921c863e962ea78548cf5991957"}
May 28 07:34:21.429179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:21.429123    2570 generic.go:358] "Generic (PLEG): container finished" podID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerID="e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda" exitCode=0
May 28 07:34:21.429622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:21.429201    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerDied","Data":"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"}
May 28 07:34:22.433811 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:22.433769    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerStarted","Data":"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"}
May 28 07:34:29.456046 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:29.456006    2570 generic.go:358] "Generic (PLEG): container finished" podID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerID="a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d" exitCode=0
May 28 07:34:29.456504 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:29.456066    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerDied","Data":"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"}
May 28 07:34:30.462218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.462167    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerStarted","Data":"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"}
May 28 07:34:30.462770 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.462227    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerStarted","Data":"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"}
May 28 07:34:30.487517 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.487451    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podStartSLOduration=16.487432454 podStartE2EDuration="16.487432454s" podCreationTimestamp="2026-05-28 07:34:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:34:30.485761097 +0000 UTC m=+1059.214667844" watchObservedRunningTime="2026-05-28 07:34:30.487432454 +0000 UTC m=+1059.216339191"
May 28 07:34:30.932164 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.932120    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:30.932355 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.932179    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:30.934063 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.934023    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
May 28 07:34:30.934226 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:30.934040    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
May 28 07:34:33.931732 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:33.931615    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
May 28 07:34:33.932100 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:33.931636    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
May 28 07:34:35.932070 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:35.932004    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:35.932070 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:35.932090    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:36.932459 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:36.932401    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
May 28 07:34:36.940130 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:36.940101    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:36.944740 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:36.944705    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:39.931824 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:39.931764    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
May 28 07:34:42.932604 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:42.932564    2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:34:42.933428 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:34:42.933405    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:36:00.529590 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.529548    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:36:00.530071 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.529805    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" podUID="b0ecc46e-652e-466d-be7e-305b2b54dd03" containerName="manager" containerID="cri-o://49dddb824614be640faea69e442e8a23c8659c175ef1a2f9c04a00d82ccef048" gracePeriod=10
May 28 07:36:00.764638 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.764605    2570 generic.go:358] "Generic (PLEG): container finished" podID="b0ecc46e-652e-466d-be7e-305b2b54dd03" containerID="49dddb824614be640faea69e442e8a23c8659c175ef1a2f9c04a00d82ccef048" exitCode=0
May 28 07:36:00.764811 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.764670    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" event={"ID":"b0ecc46e-652e-466d-be7e-305b2b54dd03","Type":"ContainerDied","Data":"49dddb824614be640faea69e442e8a23c8659c175ef1a2f9c04a00d82ccef048"}
May 28 07:36:00.783913 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.783883    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:36:00.840285 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.840246    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jccwb\" (UniqueName: \"kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb\") pod \"b0ecc46e-652e-466d-be7e-305b2b54dd03\" (UID: \"b0ecc46e-652e-466d-be7e-305b2b54dd03\") "
May 28 07:36:00.842719 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.842685    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb" (OuterVolumeSpecName: "kube-api-access-jccwb") pod "b0ecc46e-652e-466d-be7e-305b2b54dd03" (UID: "b0ecc46e-652e-466d-be7e-305b2b54dd03"). InnerVolumeSpecName "kube-api-access-jccwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:36:00.920867 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.920832    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:36:00.921172 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.921129    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry" containerID="cri-o://7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50" gracePeriod=30
May 28 07:36:00.921317 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.921174    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" containerID="cri-o://ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e" gracePeriod=30
May 28 07:36:00.928415 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.928384    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:36:00.928759 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.928717    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry" containerID="cri-o://8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2" gracePeriod=30
May 28 07:36:00.928872 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.928752    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" containerID="cri-o://4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20" gracePeriod=30
May 28 07:36:00.941771 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:00.941733    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jccwb\" (UniqueName: \"kubernetes.io/projected/b0ecc46e-652e-466d-be7e-305b2b54dd03-kube-api-access-jccwb\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:01.771296 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.771268    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"
May 28 07:36:01.771729 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.771261    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt" event={"ID":"b0ecc46e-652e-466d-be7e-305b2b54dd03","Type":"ContainerDied","Data":"b1f157591bbddade26cdf07f59ae05a8a0b3e94903d76f3810c91159377748a8"}
May 28 07:36:01.771729 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.771377    2570 scope.go:117] "RemoveContainer" containerID="49dddb824614be640faea69e442e8a23c8659c175ef1a2f9c04a00d82ccef048"
May 28 07:36:01.794518 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.794479    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:36:01.798256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.798228    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-75fb7d9844-7x9jt"]
May 28 07:36:01.877823 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:01.877786    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ecc46e-652e-466d-be7e-305b2b54dd03" path="/var/lib/kubelet/pods/b0ecc46e-652e-466d-be7e-305b2b54dd03/volumes"
May 28 07:36:02.780889 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:02.780822    2570 generic.go:358] "Generic (PLEG): container finished" podID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerID="ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e" exitCode=0
May 28 07:36:02.781632 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:02.780939    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerDied","Data":"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"}
May 28 07:36:02.784765 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:02.784720    2570 generic.go:358] "Generic (PLEG): container finished" podID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerID="4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20" exitCode=0
May 28 07:36:02.785019 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:02.784782    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerDied","Data":"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"}
May 28 07:36:03.228929 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.228891    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:36:03.229133 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.229112    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" podUID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" containerName="postgres" containerID="cri-o://e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31" gracePeriod=30
May 28 07:36:03.235456 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.235411    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:36:03.236111 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.236082    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-cl5cv" podUID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" containerName="redis" containerID="cri-o://b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072" gracePeriod=30
May 28 07:36:03.503608 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.503585    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:36:03.506650 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.506630    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:36:03.562716 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.562668    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtxjs\" (UniqueName: \"kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs\") pod \"c04601cb-cdbc-48a3-a8f9-00003c6603e2\" (UID: \"c04601cb-cdbc-48a3-a8f9-00003c6603e2\") "
May 28 07:36:03.565105 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.565074    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs" (OuterVolumeSpecName: "kube-api-access-dtxjs") pod "c04601cb-cdbc-48a3-a8f9-00003c6603e2" (UID: "c04601cb-cdbc-48a3-a8f9-00003c6603e2"). InnerVolumeSpecName "kube-api-access-dtxjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:36:03.663308 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.663269    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata\") pod \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") "
May 28 07:36:03.663528 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.663370    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pcc5\" (UniqueName: \"kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5\") pod \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\" (UID: \"85fdb9d5-2f8c-439b-a5dd-79f89101efe6\") "
May 28 07:36:03.663615 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.663557    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtxjs\" (UniqueName: \"kubernetes.io/projected/c04601cb-cdbc-48a3-a8f9-00003c6603e2-kube-api-access-dtxjs\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:03.665687 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.665655    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5" (OuterVolumeSpecName: "kube-api-access-7pcc5") pod "85fdb9d5-2f8c-439b-a5dd-79f89101efe6" (UID: "85fdb9d5-2f8c-439b-a5dd-79f89101efe6"). InnerVolumeSpecName "kube-api-access-7pcc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:36:03.694715 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.694670    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "85fdb9d5-2f8c-439b-a5dd-79f89101efe6" (UID: "85fdb9d5-2f8c-439b-a5dd-79f89101efe6"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:36:03.764456 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.764370    2570 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-postgresdata\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:03.764456 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.764402    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pcc5\" (UniqueName: \"kubernetes.io/projected/85fdb9d5-2f8c-439b-a5dd-79f89101efe6-kube-api-access-7pcc5\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:03.788775 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.788736    2570 generic.go:358] "Generic (PLEG): container finished" podID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" containerID="b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072" exitCode=0
May 28 07:36:03.789256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.788791    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-cl5cv"
May 28 07:36:03.789256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.788829    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-cl5cv" event={"ID":"c04601cb-cdbc-48a3-a8f9-00003c6603e2","Type":"ContainerDied","Data":"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"}
May 28 07:36:03.789256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.788883    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-cl5cv" event={"ID":"c04601cb-cdbc-48a3-a8f9-00003c6603e2","Type":"ContainerDied","Data":"4b9f6e55302e5f8e77683ea1cffcee2bf9274dfcd57c94a90f1fa65131ec6f93"}
May 28 07:36:03.789256 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.788910    2570 scope.go:117] "RemoveContainer" containerID="b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"
May 28 07:36:03.790007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.789944    2570 generic.go:358] "Generic (PLEG): container finished" podID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" containerID="e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31" exitCode=0
May 28 07:36:03.790007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.789988    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"
May 28 07:36:03.790111 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.790024    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" event={"ID":"85fdb9d5-2f8c-439b-a5dd-79f89101efe6","Type":"ContainerDied","Data":"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"}
May 28 07:36:03.790111 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.790043    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-rhvgq" event={"ID":"85fdb9d5-2f8c-439b-a5dd-79f89101efe6","Type":"ContainerDied","Data":"45828f465888fa1b8b45fafd89b5d5d56684aecb2986c4c8665eda0058eb5b09"}
May 28 07:36:03.798716 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.798693    2570 scope.go:117] "RemoveContainer" containerID="b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"
May 28 07:36:03.799053 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:03.799026    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072\": container with ID starting with b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072 not found: ID does not exist" containerID="b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"
May 28 07:36:03.799146 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.799066    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072"} err="failed to get container status \"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072\": rpc error: code = NotFound desc = could not find container \"b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072\": container with ID starting with b3430d72437c1391e8aefdac30cab9f67de3ae1c9e830d36be6e48a518dd0072 not found: ID does not exist"
May 28 07:36:03.799146 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.799093    2570 scope.go:117] "RemoveContainer" containerID="e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"
May 28 07:36:03.807002 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.806984    2570 scope.go:117] "RemoveContainer" containerID="e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"
May 28 07:36:03.807263 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:03.807245    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31\": container with ID starting with e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31 not found: ID does not exist" containerID="e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"
May 28 07:36:03.807356 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.807274    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31"} err="failed to get container status \"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31\": rpc error: code = NotFound desc = could not find container \"e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31\": container with ID starting with e16c6b100573a154ddd609102932607585bd66879750257443ad78068b323e31 not found: ID does not exist"
May 28 07:36:03.812722 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.812699    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:36:03.818302 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.818274    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-cl5cv"]
May 28 07:36:03.828639 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.828611    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:36:03.830418 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.830395    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-rhvgq"]
May 28 07:36:03.877631 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.877559    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" path="/var/lib/kubelet/pods/85fdb9d5-2f8c-439b-a5dd-79f89101efe6/volumes"
May 28 07:36:03.877964 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:03.877947    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" path="/var/lib/kubelet/pods/c04601cb-cdbc-48a3-a8f9-00003c6603e2/volumes"
May 28 07:36:06.941148 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:06.941095    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
May 28 07:36:07.677651 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:07.677598    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
May 28 07:36:16.941703 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:16.941657    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
May 28 07:36:17.677690 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:17.677638    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
May 28 07:36:26.941558 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:26.941508    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
May 28 07:36:26.942008 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:26.941666    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:36:27.677757 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:27.677704    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
May 28 07:36:27.677941 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:27.677878    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:36:31.597506 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.597479    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:36:31.600842 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.600822    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:36:31.699956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.699851    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") pod \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") "
May 28 07:36:31.699956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.699903    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") pod \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") "
May 28 07:36:31.699956 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.699935    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls\") pod \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") "
May 28 07:36:31.700378 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.699968    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data\") pod \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") "
May 28 07:36:31.700378 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700000    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4lhc\" (UniqueName: \"kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc\") pod \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") "
May 28 07:36:31.700378 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700020    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls\") pod \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") "
May 28 07:36:31.700378 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700058    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwl4f\" (UniqueName: \"kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f\") pod \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\" (UID: \"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0\") "
May 28 07:36:31.700601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700532    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data" (OuterVolumeSpecName: "feast-data") pod "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" (UID: "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:36:31.700601 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700579    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data\") pod \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\" (UID: \"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2\") "
May 28 07:36:31.700884 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.700858    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.702833 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.702801    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls" (OuterVolumeSpecName: "online-tls") pod "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" (UID: "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:36:31.702949 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.702827    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc" (OuterVolumeSpecName: "kube-api-access-b4lhc") pod "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" (UID: "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2"). InnerVolumeSpecName "kube-api-access-b4lhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:36:31.703010 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.702945    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls" (OuterVolumeSpecName: "online-tls") pod "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" (UID: "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:36:31.703069 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.702971    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f" (OuterVolumeSpecName: "kube-api-access-lwl4f") pod "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" (UID: "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0"). InnerVolumeSpecName "kube-api-access-lwl4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:36:31.703720 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.703692    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" (UID: "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:36:31.703822 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.703777    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" (UID: "edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 07:36:31.711122 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.711093    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data" (OuterVolumeSpecName: "feast-data") pod "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" (UID: "023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:36:31.802189 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802151    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4lhc\" (UniqueName: \"kubernetes.io/projected/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-kube-api-access-b4lhc\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802189 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802183    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802189 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802192    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwl4f\" (UniqueName: \"kubernetes.io/projected/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-kube-api-access-lwl4f\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802479 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802203    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-feast-data\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802479 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802213    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802479 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802220    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-registry-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.802479 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.802228    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2-online-tls\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:36:31.881227 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.881193    2570 generic.go:358] "Generic (PLEG): container finished" podID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerID="7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50" exitCode=137
May 28 07:36:31.881476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.881271    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"
May 28 07:36:31.881476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.881282    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerDied","Data":"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"}
May 28 07:36:31.881476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.881347    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2" event={"ID":"023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2","Type":"ContainerDied","Data":"8dc7d060497df9c29f8e59d7cce562b83f5d1af8242e9eccf1f2b1468307cf93"}
May 28 07:36:31.881476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.881370    2570 scope.go:117] "RemoveContainer" containerID="ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"
May 28 07:36:31.884071 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.884044    2570 generic.go:358] "Generic (PLEG): container finished" podID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerID="8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2" exitCode=137
May 28 07:36:31.884222 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.884120    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerDied","Data":"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"}
May 28 07:36:31.884222 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.884138    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"
May 28 07:36:31.884222 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.884152    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq" event={"ID":"edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0","Type":"ContainerDied","Data":"a21e493127093fd081e7b6b96320342c7e1b2921c863e962ea78548cf5991957"}
May 28 07:36:31.891543 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.891412    2570 scope.go:117] "RemoveContainer" containerID="7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"
May 28 07:36:31.900226 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.900211    2570 scope.go:117] "RemoveContainer" containerID="b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"
May 28 07:36:31.907755 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.907735    2570 scope.go:117] "RemoveContainer" containerID="b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"
May 28 07:36:31.909985 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.909964    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:36:31.913579 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.913554    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d75b57b87-xwnj2"]
May 28 07:36:31.916535 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.916512    2570 scope.go:117] "RemoveContainer" containerID="ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"
May 28 07:36:31.916817 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.916796    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e\": container with ID starting with ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e not found: ID does not exist" containerID="ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"
May 28 07:36:31.916891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.916831    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e"} err="failed to get container status \"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e\": rpc error: code = NotFound desc = could not find container \"ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e\": container with ID starting with ed5c1f0e02b2907c43276b86029867bf8ce9859d6a6d7a91fbdde24199f5ac8e not found: ID does not exist"
May 28 07:36:31.916891 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.916860    2570 scope.go:117] "RemoveContainer" containerID="7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"
May 28 07:36:31.917106 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.917088    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50\": container with ID starting with 7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50 not found: ID does not exist" containerID="7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"
May 28 07:36:31.917155 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917114    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50"} err="failed to get container status \"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50\": rpc error: code = NotFound desc = could not find container \"7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50\": container with ID starting with 7002664eb6842be97e8b4cc0aa4eca2c460ebe2cc09c0369bd257455eb3c2d50 not found: ID does not exist"
May 28 07:36:31.917155 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917138    2570 scope.go:117] "RemoveContainer" containerID="b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"
May 28 07:36:31.917404 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.917384    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1\": container with ID starting with b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1 not found: ID does not exist" containerID="b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"
May 28 07:36:31.917493 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917409    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1"} err="failed to get container status \"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1\": rpc error: code = NotFound desc = could not find container \"b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1\": container with ID starting with b8f5b96ff28c0e14b595102b67050daf8cbc9cf59272cc11f600f0f65e978ff1 not found: ID does not exist"
May 28 07:36:31.917493 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917424    2570 scope.go:117] "RemoveContainer" containerID="b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"
May 28 07:36:31.917647 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.917630    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4\": container with ID starting with b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4 not found: ID does not exist" containerID="b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"
May 28 07:36:31.917699 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917651    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4"} err="failed to get container status \"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4\": rpc error: code = NotFound desc = could not find container \"b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4\": container with ID starting with b97c7f481b22a87ad982c9aca6273a44cb29132bb1c1e2a8983a68f589ad63c4 not found: ID does not exist"
May 28 07:36:31.917699 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.917664    2570 scope.go:117] "RemoveContainer" containerID="4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"
May 28 07:36:31.926036 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.925881    2570 scope.go:117] "RemoveContainer" containerID="8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"
May 28 07:36:31.926952 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.926913    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:36:31.930554 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.930531    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-b577fffb-55rdq"]
May 28 07:36:31.940995 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.940972    2570 scope.go:117] "RemoveContainer" containerID="a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"
May 28 07:36:31.948879 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.948859    2570 scope.go:117] "RemoveContainer" containerID="e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"
May 28 07:36:31.956018 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.955998    2570 scope.go:117] "RemoveContainer" containerID="4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"
May 28 07:36:31.956274 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.956255    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20\": container with ID starting with 4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20 not found: ID does not exist" containerID="4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"
May 28 07:36:31.956367 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956286    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20"} err="failed to get container status \"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20\": rpc error: code = NotFound desc = could not find container \"4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20\": container with ID starting with 4847c7ec28d5028b8f8827ef1bf7dc56dc0ce16cda5d7f84e3b8f4f436422f20 not found: ID does not exist"
May 28 07:36:31.956367 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956315    2570 scope.go:117] "RemoveContainer" containerID="8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"
May 28 07:36:31.956620 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.956602    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2\": container with ID starting with 8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2 not found: ID does not exist" containerID="8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"
May 28 07:36:31.956665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956628    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2"} err="failed to get container status \"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2\": rpc error: code = NotFound desc = could not find container \"8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2\": container with ID starting with 8e866d14ace2b3febc1dcd2608d6a0f0b3b48d451b0ace2579a62f33e5f256c2 not found: ID does not exist"
May 28 07:36:31.956665 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956645    2570 scope.go:117] "RemoveContainer" containerID="a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"
May 28 07:36:31.956894 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.956877    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d\": container with ID starting with a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d not found: ID does not exist" containerID="a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"
May 28 07:36:31.956963 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956902    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d"} err="failed to get container status \"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d\": rpc error: code = NotFound desc = could not find container \"a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d\": container with ID starting with a6690e27993edbe57b6d74b84a600bc65ff7a2d856c6fb985da589b7e5ce185d not found: ID does not exist"
May 28 07:36:31.956963 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.956927    2570 scope.go:117] "RemoveContainer" containerID="e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"
May 28 07:36:31.957152 ip-10-0-130-201 kubenswrapper[2570]: E0528 07:36:31.957133    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda\": container with ID starting with e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda not found: ID does not exist" containerID="e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"
May 28 07:36:31.957199 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:31.957158    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda"} err="failed to get container status \"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda\": rpc error: code = NotFound desc = could not find container \"e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda\": container with ID starting with e6b6276c7c18173a3ff6be88209d3416b3c97c83a27135383c58601002d5ddda not found: ID does not exist"
May 28 07:36:33.877208 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:33.877167    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" path="/var/lib/kubelet/pods/023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2/volumes"
May 28 07:36:33.877752 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:33.877735    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" path="/var/lib/kubelet/pods/edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0/volumes"
May 28 07:36:51.818126 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:51.818094    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:36:51.821073 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:36:51.821049    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:41:51.839546 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:41:51.839518    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:41:51.846616 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:41:51.846594    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:46:51.868012 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:51.867980    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:46:51.871992 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:51.871966    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:46:55.262750 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.262719    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zv9k5/must-gather-88lfj"]
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263004    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="feast-apply"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263014    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="feast-apply"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263020    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263025    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263033    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="feast-apply"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263038    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="feast-apply"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263047    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263052    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263060    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" containerName="redis"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263065    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" containerName="redis"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263070    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="feast-init"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263076    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="feast-init"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263082    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263086    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263092    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="feast-init"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263097    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="feast-init"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263104    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online"
May 28 07:46:55.263104 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263108    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263120    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" containerName="postgres"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263125    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" containerName="postgres"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263132    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ecc46e-652e-466d-be7e-305b2b54dd03" containerName="manager"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263136    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ecc46e-652e-466d-be7e-305b2b54dd03" containerName="manager"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263184    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="85fdb9d5-2f8c-439b-a5dd-79f89101efe6" containerName="postgres"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263190    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="online"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263196    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="c04601cb-cdbc-48a3-a8f9-00003c6603e2" containerName="redis"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263202    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="registry"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263210    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0ecc46e-652e-466d-be7e-305b2b54dd03" containerName="manager"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263215    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="023bd2d8-e1e9-43ba-aad2-eafb7e0c36c2" containerName="registry"
May 28 07:46:55.263769 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.263221    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="edd2cdf1-bbc5-4acf-bbd7-c2eb33be99a0" containerName="online"
May 28 07:46:55.266344 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.266313    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.268906 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.268882    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zv9k5\"/\"openshift-service-ca.crt\""
May 28 07:46:55.269030 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.269010    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zv9k5\"/\"kube-root-ca.crt\""
May 28 07:46:55.269098 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.269043    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zv9k5\"/\"default-dockercfg-njkhm\""
May 28 07:46:55.273406 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.273388    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zv9k5/must-gather-88lfj"]
May 28 07:46:55.328428 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.328406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.328513 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.328451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l99m\" (UniqueName: \"kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.429562 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.429534    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l99m\" (UniqueName: \"kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.429714 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.429598    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.429930 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.429911    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.437648 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.437614    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l99m\" (UniqueName: \"kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m\") pod \"must-gather-88lfj\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") " pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.598669 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.598644    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:46:55.724710 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.724680    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zv9k5/must-gather-88lfj"]
May 28 07:46:55.727838 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:46:55.727810    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod694c6e8a_23ea_4369_bce6_26d88408cbc7.slice/crio-256c81dca289305fcebe2752e91445d9421c5696936eebb3fbba578373b9ae9e WatchSource:0}: Error finding container 256c81dca289305fcebe2752e91445d9421c5696936eebb3fbba578373b9ae9e: Status 404 returned error can't find the container with id 256c81dca289305fcebe2752e91445d9421c5696936eebb3fbba578373b9ae9e
May 28 07:46:55.729522 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.729495    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:46:55.751179 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:46:55.751152    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zv9k5/must-gather-88lfj" event={"ID":"694c6e8a-23ea-4369-bce6-26d88408cbc7","Type":"ContainerStarted","Data":"256c81dca289305fcebe2752e91445d9421c5696936eebb3fbba578373b9ae9e"}
May 28 07:47:02.780647 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:02.780609    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zv9k5/must-gather-88lfj" event={"ID":"694c6e8a-23ea-4369-bce6-26d88408cbc7","Type":"ContainerStarted","Data":"9e53727ff011a93a4c0b69d4e1a6fa51c53fd28d2387b811c2187551e4e4480c"}
May 28 07:47:02.780647 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:02.780646    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zv9k5/must-gather-88lfj" event={"ID":"694c6e8a-23ea-4369-bce6-26d88408cbc7","Type":"ContainerStarted","Data":"a8eee6dff32c15f035082cf842a39a41eca0f4c8ba527c8e70275a9f904e9a36"}
May 28 07:47:02.797388 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:02.797296    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zv9k5/must-gather-88lfj" podStartSLOduration=1.725042366 podStartE2EDuration="7.797282977s" podCreationTimestamp="2026-05-28 07:46:55 +0000 UTC" firstStartedPulling="2026-05-28 07:46:55.729656885 +0000 UTC m=+1804.458563596" lastFinishedPulling="2026-05-28 07:47:01.801897494 +0000 UTC m=+1810.530804207" observedRunningTime="2026-05-28 07:47:02.795110491 +0000 UTC m=+1811.524017226" watchObservedRunningTime="2026-05-28 07:47:02.797282977 +0000 UTC m=+1811.526189711"
May 28 07:47:11.807693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:11.807660    2570 generic.go:358] "Generic (PLEG): container finished" podID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerID="a8eee6dff32c15f035082cf842a39a41eca0f4c8ba527c8e70275a9f904e9a36" exitCode=0
May 28 07:47:11.807693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:11.807703    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zv9k5/must-gather-88lfj" event={"ID":"694c6e8a-23ea-4369-bce6-26d88408cbc7","Type":"ContainerDied","Data":"a8eee6dff32c15f035082cf842a39a41eca0f4c8ba527c8e70275a9f904e9a36"}
May 28 07:47:11.808136 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:11.807992    2570 scope.go:117] "RemoveContainer" containerID="a8eee6dff32c15f035082cf842a39a41eca0f4c8ba527c8e70275a9f904e9a36"
May 28 07:47:12.227823 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.227732    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zv9k5_must-gather-88lfj_694c6e8a-23ea-4369-bce6-26d88408cbc7/gather/0.log"
May 28 07:47:12.728177 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.728152    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p54l4/must-gather-7pct4"]
May 28 07:47:12.730509 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.730494    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.732943 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.732920    2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p54l4\"/\"default-dockercfg-gzkrb\""
May 28 07:47:12.733063 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.732943    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p54l4\"/\"openshift-service-ca.crt\""
May 28 07:47:12.733970 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.733957    2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p54l4\"/\"kube-root-ca.crt\""
May 28 07:47:12.737720 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.737700    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54l4/must-gather-7pct4"]
May 28 07:47:12.747760 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.747741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgkl\" (UniqueName: \"kubernetes.io/projected/ef6b02c6-98d9-435f-b579-aabb11e9963d-kube-api-access-jxgkl\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.747852 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.747780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ef6b02c6-98d9-435f-b579-aabb11e9963d-must-gather-output\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.848301 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.848278    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgkl\" (UniqueName: \"kubernetes.io/projected/ef6b02c6-98d9-435f-b579-aabb11e9963d-kube-api-access-jxgkl\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.848625 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.848318    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ef6b02c6-98d9-435f-b579-aabb11e9963d-must-gather-output\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.848625 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.848566    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ef6b02c6-98d9-435f-b579-aabb11e9963d-must-gather-output\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:12.855693 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:12.855671    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgkl\" (UniqueName: \"kubernetes.io/projected/ef6b02c6-98d9-435f-b579-aabb11e9963d-kube-api-access-jxgkl\") pod \"must-gather-7pct4\" (UID: \"ef6b02c6-98d9-435f-b579-aabb11e9963d\") " pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:13.040388 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:13.040369    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54l4/must-gather-7pct4"
May 28 07:47:13.162290 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:13.162263    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54l4/must-gather-7pct4"]
May 28 07:47:13.164703 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:47:13.164630    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef6b02c6_98d9_435f_b579_aabb11e9963d.slice/crio-5f964f20d78e2a39dc2a1cf1bf249bc8294e4325034d1a7a27189ae15c88059f WatchSource:0}: Error finding container 5f964f20d78e2a39dc2a1cf1bf249bc8294e4325034d1a7a27189ae15c88059f: Status 404 returned error can't find the container with id 5f964f20d78e2a39dc2a1cf1bf249bc8294e4325034d1a7a27189ae15c88059f
May 28 07:47:13.815143 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:13.815110    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54l4/must-gather-7pct4" event={"ID":"ef6b02c6-98d9-435f-b579-aabb11e9963d","Type":"ContainerStarted","Data":"5f964f20d78e2a39dc2a1cf1bf249bc8294e4325034d1a7a27189ae15c88059f"}
May 28 07:47:14.821883 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:14.821841    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54l4/must-gather-7pct4" event={"ID":"ef6b02c6-98d9-435f-b579-aabb11e9963d","Type":"ContainerStarted","Data":"001ef7f339fc76de81eb707b8327970e02eb0318115cb6c9b798c581d79118fa"}
May 28 07:47:14.822289 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:14.821890    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54l4/must-gather-7pct4" event={"ID":"ef6b02c6-98d9-435f-b579-aabb11e9963d","Type":"ContainerStarted","Data":"5de3ffaf2cb0d3fc3934402ead172fe19df745f29b5dd6a19505a1ac5c221069"}
May 28 07:47:14.838532 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:14.838479    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p54l4/must-gather-7pct4" podStartSLOduration=2.065138026 podStartE2EDuration="2.838465531s" podCreationTimestamp="2026-05-28 07:47:12 +0000 UTC" firstStartedPulling="2026-05-28 07:47:13.166423808 +0000 UTC m=+1821.895330519" lastFinishedPulling="2026-05-28 07:47:13.939751311 +0000 UTC m=+1822.668658024" observedRunningTime="2026-05-28 07:47:14.837506536 +0000 UTC m=+1823.566413271" watchObservedRunningTime="2026-05-28 07:47:14.838465531 +0000 UTC m=+1823.567372269"
May 28 07:47:15.277593 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:15.277510    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wdf7z_bef55471-f8e6-4583-9731-ff4fa58fecb3/global-pull-secret-syncer/0.log"
May 28 07:47:15.327444 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:15.327413    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9r4f2_e606ad01-92b8-42ca-9767-01079f9685fd/konnectivity-agent/0.log"
May 28 07:47:15.434838 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:15.434808    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-201.ec2.internal_0752c8239f921abcfce7c2a2e59fa864/haproxy/0.log"
May 28 07:47:17.564747 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.564710    2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-zv9k5/must-gather-88lfj"]
May 28 07:47:17.565647 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.565612    2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-zv9k5/must-gather-88lfj" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="copy" containerID="cri-o://9e53727ff011a93a4c0b69d4e1a6fa51c53fd28d2387b811c2187551e4e4480c" gracePeriod=2
May 28 07:47:17.568219 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.568178    2570 status_manager.go:895] "Failed to get status for pod" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" pod="openshift-must-gather-zv9k5/must-gather-88lfj" err="pods \"must-gather-88lfj\" is forbidden: User \"system:node:ip-10-0-130-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zv9k5\": no relationship found between node 'ip-10-0-130-201.ec2.internal' and this object"
May 28 07:47:17.569140 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.569120    2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-zv9k5/must-gather-88lfj"]
May 28 07:47:17.836142 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.836070    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zv9k5_must-gather-88lfj_694c6e8a-23ea-4369-bce6-26d88408cbc7/copy/0.log"
May 28 07:47:17.836813 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.836648    2570 generic.go:358] "Generic (PLEG): container finished" podID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerID="9e53727ff011a93a4c0b69d4e1a6fa51c53fd28d2387b811c2187551e4e4480c" exitCode=143
May 28 07:47:17.939808 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.939723    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zv9k5_must-gather-88lfj_694c6e8a-23ea-4369-bce6-26d88408cbc7/copy/0.log"
May 28 07:47:17.940476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:17.940417    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:47:18.017566 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.017488    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output\") pod \"694c6e8a-23ea-4369-bce6-26d88408cbc7\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") "
May 28 07:47:18.018005 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.017946    2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l99m\" (UniqueName: \"kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m\") pod \"694c6e8a-23ea-4369-bce6-26d88408cbc7\" (UID: \"694c6e8a-23ea-4369-bce6-26d88408cbc7\") "
May 28 07:47:18.019469 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.019282    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "694c6e8a-23ea-4369-bce6-26d88408cbc7" (UID: "694c6e8a-23ea-4369-bce6-26d88408cbc7"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 07:47:18.024254 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.024214    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m" (OuterVolumeSpecName: "kube-api-access-8l99m") pod "694c6e8a-23ea-4369-bce6-26d88408cbc7" (UID: "694c6e8a-23ea-4369-bce6-26d88408cbc7"). InnerVolumeSpecName "kube-api-access-8l99m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 07:47:18.120795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.120672    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l99m\" (UniqueName: \"kubernetes.io/projected/694c6e8a-23ea-4369-bce6-26d88408cbc7-kube-api-access-8l99m\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:47:18.120795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.120714    2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/694c6e8a-23ea-4369-bce6-26d88408cbc7-must-gather-output\") on node \"ip-10-0-130-201.ec2.internal\" DevicePath \"\""
May 28 07:47:18.288406 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.288248    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/alertmanager/0.log"
May 28 07:47:18.321819 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.321788    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/config-reloader/0.log"
May 28 07:47:18.350484 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.350449    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/kube-rbac-proxy-web/0.log"
May 28 07:47:18.374820 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.374728    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/kube-rbac-proxy/0.log"
May 28 07:47:18.397511 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.397478    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/kube-rbac-proxy-metric/0.log"
May 28 07:47:18.421480 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.421421    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/prom-label-proxy/0.log"
May 28 07:47:18.443796 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.443687    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c74cd281-64df-4b18-8691-e01566d82c70/init-config-reloader/0.log"
May 28 07:47:18.483782 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.483746    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-vpfps_6dbc55b7-906d-4d5f-8a72-65500a7fd34b/cluster-monitoring-operator/0.log"
May 28 07:47:18.511760 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.511728    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gzdns_46cbd6a3-ca2c-47fe-8455-098baf850501/kube-state-metrics/0.log"
May 28 07:47:18.530110 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.530079    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gzdns_46cbd6a3-ca2c-47fe-8455-098baf850501/kube-rbac-proxy-main/0.log"
May 28 07:47:18.551117 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.551087    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gzdns_46cbd6a3-ca2c-47fe-8455-098baf850501/kube-rbac-proxy-self/0.log"
May 28 07:47:18.577582 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.577553    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55b9b594dc-h9lvm_87a0acde-0daf-4f78-acee-607a6d42fd54/metrics-server/0.log"
May 28 07:47:18.634548 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.634459    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qr82_de63b126-71a8-48ca-88a3-57ed85e0c70f/node-exporter/0.log"
May 28 07:47:18.657980 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.657948    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qr82_de63b126-71a8-48ca-88a3-57ed85e0c70f/kube-rbac-proxy/0.log"
May 28 07:47:18.681007 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.680977    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qr82_de63b126-71a8-48ca-88a3-57ed85e0c70f/init-textfile/0.log"
May 28 07:47:18.841528 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.841501    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zv9k5_must-gather-88lfj_694c6e8a-23ea-4369-bce6-26d88408cbc7/copy/0.log"
May 28 07:47:18.842461 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.842435    2570 scope.go:117] "RemoveContainer" containerID="9e53727ff011a93a4c0b69d4e1a6fa51c53fd28d2387b811c2187551e4e4480c"
May 28 07:47:18.842624 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.842590    2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zv9k5/must-gather-88lfj"
May 28 07:47:18.855006 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.853798    2570 scope.go:117] "RemoveContainer" containerID="a8eee6dff32c15f035082cf842a39a41eca0f4c8ba527c8e70275a9f904e9a36"
May 28 07:47:18.868009 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.867977    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xkll6_b60e2eac-1c0a-4b98-aa5c-463ec6323725/kube-rbac-proxy-main/0.log"
May 28 07:47:18.888218 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.888124    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xkll6_b60e2eac-1c0a-4b98-aa5c-463ec6323725/kube-rbac-proxy-self/0.log"
May 28 07:47:18.908213 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:18.908182    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xkll6_b60e2eac-1c0a-4b98-aa5c-463ec6323725/openshift-state-metrics/0.log"
May 28 07:47:19.162561 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:19.162469    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-57nkx_27da6ccb-8333-4c83-90d2-24242dd98ab5/prometheus-operator-admission-webhook/0.log"
May 28 07:47:19.193266 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:19.193199    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d5bbf55-s2qp8_8824e993-2cda-42f7-93b5-c33d81fdc6d9/telemeter-client/0.log"
May 28 07:47:19.218303 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:19.218271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d5bbf55-s2qp8_8824e993-2cda-42f7-93b5-c33d81fdc6d9/reload/0.log"
May 28 07:47:19.242572 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:19.242533    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66d5bbf55-s2qp8_8824e993-2cda-42f7-93b5-c33d81fdc6d9/kube-rbac-proxy/0.log"
May 28 07:47:19.881586 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:19.881123    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" path="/var/lib/kubelet/pods/694c6e8a-23ea-4369-bce6-26d88408cbc7/volumes"
May 28 07:47:21.252622 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.252590    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7df4d694cc-xr52k_da915ec4-2005-422b-b6e8-d109fa918131/console/0.log"
May 28 07:47:21.287089 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.287045    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-xcjhs_5b83670d-3936-4008-a9ad-1791126fb088/download-server/0.log"
May 28 07:47:21.509899 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.509811    2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"]
May 28 07:47:21.510643 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.510615    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="gather"
May 28 07:47:21.510792 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.510778    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="gather"
May 28 07:47:21.510917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.510904    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="copy"
May 28 07:47:21.511017 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.511006    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="copy"
May 28 07:47:21.511214 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.511201    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="gather"
May 28 07:47:21.511300 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.511289    2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="694c6e8a-23ea-4369-bce6-26d88408cbc7" containerName="copy"
May 28 07:47:21.514885 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.514613    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.525926 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.523233    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"]
May 28 07:47:21.651731 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.651698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-podres\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.651881 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.651746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhmv\" (UniqueName: \"kubernetes.io/projected/542243ac-4db2-4176-80c5-c733da931d57-kube-api-access-dqhmv\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.651881 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.651807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-lib-modules\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.651881 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.651854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-proc\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.651881 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.651872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-sys\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.675476 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.675448    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-nhvml_59b3e7c9-72be-43a3-aa28-af25ac45b27d/volume-data-source-validator/0.log"
May 28 07:47:21.752736 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752711    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhmv\" (UniqueName: \"kubernetes.io/projected/542243ac-4db2-4176-80c5-c733da931d57-kube-api-access-dqhmv\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.752876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752755    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-lib-modules\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.752876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752785    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-proc\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.752876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752802    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-sys\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.752876 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752826    2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-podres\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.753022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752908    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-sys\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.753022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752948    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-podres\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.753022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752958    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-proc\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.753022 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.752960    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/542243ac-4db2-4176-80c5-c733da931d57-lib-modules\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.761999 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.761938    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhmv\" (UniqueName: \"kubernetes.io/projected/542243ac-4db2-4176-80c5-c733da931d57-kube-api-access-dqhmv\") pod \"perf-node-gather-daemonset-zlpwp\" (UID: \"542243ac-4db2-4176-80c5-c733da931d57\") " pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.829470 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.829445    2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:21.983872 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:21.983839    2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"]
May 28 07:47:21.987064 ip-10-0-130-201 kubenswrapper[2570]: W0528 07:47:21.987033    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod542243ac_4db2_4176_80c5_c733da931d57.slice/crio-32b89b0349edecc6718a2e033cc32dc004eab675d4f1ef8e8117664c4798313e WatchSource:0}: Error finding container 32b89b0349edecc6718a2e033cc32dc004eab675d4f1ef8e8117664c4798313e: Status 404 returned error can't find the container with id 32b89b0349edecc6718a2e033cc32dc004eab675d4f1ef8e8117664c4798313e
May 28 07:47:22.320982 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.320950    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8szw5_3e84310f-06d6-4835-b848-441d2e2a4da1/dns/0.log"
May 28 07:47:22.338917 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.338891    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8szw5_3e84310f-06d6-4835-b848-441d2e2a4da1/kube-rbac-proxy/0.log"
May 28 07:47:22.475932 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.475903    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tzs7h_cd3587d4-3dec-4896-9b9a-7c51839245e2/dns-node-resolver/0.log"
May 28 07:47:22.859802 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.859750    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp" event={"ID":"542243ac-4db2-4176-80c5-c733da931d57","Type":"ContainerStarted","Data":"ebd382b6848a361462571eb8b20b97ec154511872eee72c7038885b3ec0bc4ce"}
May 28 07:47:22.859802 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.859794    2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp" event={"ID":"542243ac-4db2-4176-80c5-c733da931d57","Type":"ContainerStarted","Data":"32b89b0349edecc6718a2e033cc32dc004eab675d4f1ef8e8117664c4798313e"}
May 28 07:47:22.860061 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.859877    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:22.863268 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.863248    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-894dv_83bca63d-7be2-4448-b3e6-979e625f7582/node-ca/0.log"
May 28 07:47:22.876021 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:22.875980    2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp" podStartSLOduration=1.87596936 podStartE2EDuration="1.87596936s" podCreationTimestamp="2026-05-28 07:47:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:47:22.873630433 +0000 UTC m=+1831.602537168" watchObservedRunningTime="2026-05-28 07:47:22.87596936 +0000 UTC m=+1831.604876093"
May 28 07:47:23.880010 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:23.879983    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q766_5ad0fd15-20a2-44fc-969d-0468e04b4bdc/serve-healthcheck-canary/0.log"
May 28 07:47:24.357027 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:24.356999    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs5hf_4aadcea9-42a8-44ca-ab25-5eb750c3f713/kube-rbac-proxy/0.log"
May 28 07:47:24.374996 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:24.374976    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs5hf_4aadcea9-42a8-44ca-ab25-5eb750c3f713/exporter/0.log"
May 28 07:47:24.397708 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:24.397683    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs5hf_4aadcea9-42a8-44ca-ab25-5eb750c3f713/extractor/0.log"
May 28 07:47:28.872705 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:28.872679    2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p54l4/perf-node-gather-daemonset-zlpwp"
May 28 07:47:29.375481 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.375453    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/kube-multus-additional-cni-plugins/0.log"
May 28 07:47:29.397997 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.397963    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/egress-router-binary-copy/0.log"
May 28 07:47:29.420679 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.420646    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/cni-plugins/0.log"
May 28 07:47:29.444346 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.444311    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/bond-cni-plugin/0.log"
May 28 07:47:29.467795 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.467770    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/routeoverride-cni/0.log"
May 28 07:47:29.495311 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.495289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/whereabouts-cni-bincopy/0.log"
May 28 07:47:29.517763 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.517735    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s27sk_9a805528-1688-4c27-b36d-74df2df15f70/whereabouts-cni/0.log"
May 28 07:47:29.559251 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.559224    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jgmst_2ebcd8aa-aedb-47a1-a69f-8d475351871f/kube-multus/0.log"
May 28 07:47:29.609398 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.609371    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48cgt_a3d00dbf-6569-4d01-9db6-3eb65903a4e7/network-metrics-daemon/0.log"
May 28 07:47:29.627224 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:29.627158    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48cgt_a3d00dbf-6569-4d01-9db6-3eb65903a4e7/kube-rbac-proxy/0.log"
May 28 07:47:30.510067 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.510034    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-controller/0.log"
May 28 07:47:30.527276 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.527247    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/0.log"
May 28 07:47:30.556208 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.556177    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovn-acl-logging/1.log"
May 28 07:47:30.576429 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.576392    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/kube-rbac-proxy-node/0.log"
May 28 07:47:30.603913 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.603882    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/kube-rbac-proxy-ovn-metrics/0.log"
May 28 07:47:30.626239 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.626194    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/northd/0.log"
May 28 07:47:30.655042 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.655015    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/nbdb/0.log"
May 28 07:47:30.680790 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.680763    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/sbdb/0.log"
May 28 07:47:30.843833 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:30.843780    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2xgnb_946a664b-2d63-454a-9c6e-b63a906a8b52/ovnkube-controller/0.log"
May 28 07:47:32.496082 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:32.496056    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r8pjx_2a15d5fd-412f-44ef-a5f9-08462c299646/network-check-target-container/0.log"
May 28 07:47:33.320014 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:33.319982    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wj8hg_216ec96b-2730-4cab-8f3a-2311abc10a8f/iptables-alerter/0.log"
May 28 07:47:33.978723 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:33.978689    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wvbd7_0ebf0e05-2ee0-4e62-baac-7e2598eb6697/tuned/0.log"
May 28 07:47:35.539986 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:35.539951    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-bcmsd_325455d5-5b75-44ab-9940-f659e8df5de4/cluster-samples-operator/0.log"
May 28 07:47:35.557842 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:35.557815    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-bcmsd_325455d5-5b75-44ab-9940-f659e8df5de4/cluster-samples-operator-watch/0.log"
May 28 07:47:36.375041 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:36.375002    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-fxlzs_f12fdcfa-f4d1-4ec2-a58e-4d739410538f/service-ca-operator/1.log"
May 28 07:47:36.377143 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:36.377116    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-fxlzs_f12fdcfa-f4d1-4ec2-a58e-4d739410538f/service-ca-operator/0.log"
May 28 07:47:36.651780 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:36.651701    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-bkplg_1f3e35b1-ae3b-47f6-a5db-2e93dda53d6d/service-ca-controller/0.log"
May 28 07:47:37.041903 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:37.041879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8sm6_00dc9ab1-c2ae-4b1e-bfc5-8572975b508d/csi-driver/0.log"
May 28 07:47:37.065870 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:37.065842    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8sm6_00dc9ab1-c2ae-4b1e-bfc5-8572975b508d/csi-node-driver-registrar/0.log"
May 28 07:47:37.084950 ip-10-0-130-201 kubenswrapper[2570]: I0528 07:47:37.084927    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8sm6_00dc9ab1-c2ae-4b1e-bfc5-8572975b508d/csi-liveness-probe/0.log"